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Warped Definitions and Self Freedom 


Contemporary psychology has been concerned with the self, its “liberation,” “ac- 
tualization,” and a number of similar processes presumably involved in the identifica- 
tion and strengthening of the ego. Concomitantly, there has developed a broad general 
concern for the individual as an entity quite apart from any societal interrelationship. 
In counseling the implication has developed or is readily derivable that the person or 
self or ego exists as a totally independent element which, in its highest creative expres- 
sion, transcends any relationships with a world of reality. In this status, it is supposed 
to strive to be uninfluenced by or unconcerned with any of the factors of interpersonal 
interaction which constitute the human environment. 


The well-adjusting personality in these terms becomes a self-sufficient, self-actual- 
izing ego which feeds only upon itself for sustenance. In this framework contact with 
the world of reality often is seen as a limiting rather than a stimulating factor in per- 
sonality development. In this context some psychologists have become so obsessed with 
individuality qua individuality as to have ridden the pendulum to the ridiculous extreme 
which seems to imply that we can be human beings without need for and interaction 
with other human beings. 

In the process of liberating the psyche, certain words and expressions have become 
endowed with special meanings, usually of a negative kind—negative, that is, because 
they seem to be anathema to the freed or cleansed mind. For example: 

Responsibility: a societal imposition designed to prevent anyone from doing as he pleases about 
anything. 

Society: an organizational structure existing outside and apart from the individual whose chief 
function is to restrict his freedom. 

Respect for others: a bourgeois requirement that implies that persons other than the individual 
inhabit the universe. 

Democracy: a society without structure which exists solely to permit each individual maximum 
freedom without concern for the rights of others. 

Rights of others: a state of minimal recognition that anybody else has feelings, aspirations, 
needs; a minimal concern for any other individual, because “others” are equally expected to be fully 
autonomous, “independent of culture and environment.” 

Expectancies: what the individual has a right to get from everybody around him; this is distinct 
from societal expectancies which are antithetical to individual development. 

Maturity: a phase of chronological growth; reaching of legal and voting age; not to be confused 
with responsible, considerate, constructive behavior and the correlated attitudes. 

Structure: a form of rigidity—to be avoided in all kinds of interpersonal relationships; particular- 
ly virulent when it occurs in societal functions such as family relationships, government, when two 
or more persons are together, etc. 

Standards: a type of norm which has persisted as a neurotic cultural lag. Often these have been 
culturally determined and sometimes confused with norms as being the minimal achievement accept- 
able, and hence, an “acceptable standard.” 

The list may be expanded at will: 

A central question that remains is: Can any individual be truly free in the highest 
sense so long as he accepts only the foregoing as definitions and self-controls? Can 
the individual thus orientated function efficiently and healthily or is his eventual ac- 
complishment the microcosm of an emotional cocoon in which the inverted ego nour- 
ishes itself? 

If the latter is the goal, the food supply must inevitably give out. For, without 
supplementation from other human beings, emotional starvation and disintegration are 
inevitable. 


Daniel D. Feder 
San Francisco State College 
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Group Counseling and the Academic 


Performance of Anxious College Freshmen 


Charles D. Spielberger and Henry Weitz 
Duke University 


J. Peter Denny’ 
University of Western Ontario 


College upperclassmen with high mani- 
fest anxiety scores have been found to earn 
lower grades and to have a higher drop- 
out rate due to academic failure than non- 
anxious students with comparable ability 
(Spielberger & Katzenmeyer, 1959; Spiel- 
berger, 1962). These findings suggest that 
the full contributions of many able students 
are being lost to society through under- 
achievement or academic failure stemming 
from emotional problems. Similar findings 
obtained for college freshmen using other 
indices of emotional adjustment (Berger & 
Sutker, 1956) suggest that measures of 
anxiety or adjustment may be used to 
identify potential underachievers early in 
their college careers. The goals of the pres- 
ent study were to attempt to demonstrate 
that the academic performance of anxious 
college freshmen who were likely to be 
underachievers could be facilitated through 
the early application of group counseling 
procedures. 

Most counselors who work with college 
students usually concentrate on those who 





1This investigation was supported by a research 
grant (OM-362) from the National Institute of 
Mental Health, United States Public Health Serv- 
ice, to C. D. Spielberger and H. Weitz. Papers 
based in part on the data of this investigation were 
read by the authors at the 1961 meetings of the 
American Personnel and Guidance Association, 
Denver, Colorado, and the Southeastern Psycho- 
logical Association, Gatlinburg, Tennessee. The 
authors wish to express their appreciation to -J. 
Brown Grier and Edward S. Katkin for their 
assistance in the collection and analysis of the 
data. 


seek assistance after they have developed 
emotional or academic difficulties (Funken- 
stein, 1959; Blaine & McArthur, 1961). 
Where counselors have attempted to iden- 
tify and work with “underachievers,” it has 
been found that although counseling may 
facilitate the personal adjustment of such 
students, it has little demonstrable effect 
upon their academic performance (Baymur 
& Patterson, 1960; Broedel, Ohlsen, Proff, 
& Southard, 1960). That improvement in 
personal adjustment does not directly facili- 
tate academic achievement is not surprising. 
There is little evidence that emotional prob- 
lems are the immediate causes of poor 
academic performance. But for many stu- 
dents, emotional problems predispose them 
to develop maladaptive study habits and 
poor attitudes towards academic work 
which, in turn, lead to underachievement. 
The “therapeutic prevention” (Stevenson, 
1944) of emotional problems in college stu- 
dents, and of maladaptive academic habits 
and attitudes which may stem from such 
problems, would enable more students to 
attain the education necessary for them to 
make the contributions to society of which 
they are capable. Preventive measures of- 
fered at the beginning of the freshman year 
of college would come at a time when the 
potential for maladjustment, especially for 
the more anxious freshmen, is increased by 
special environmental stresses. The college 
freshman, in addition to adjusting to de- 
mands for academic achievement under 
conditions of increased complexity of sub- 
ject matter and heightened competition 
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from peers, is also frequently confronted 
with the task of establishing a new set of 
social relationships in a strange environ- 
ment. 


The results of two previous studies with 
preventive features suggest that emotional 
adjustment can be facilitated through group 
counseling. Arbuckle (1949) found that col- 
lege freshmen who attended compulsory 
orientation classes consisting of lectures 
and group discussions showed changes in 
personality inventory scores indicative of 
better adjustment. Rosenberg and Fuller 
(1955) found that a “Human Relations 
Seminar” for beginning nursing students 
reduced the withdrawal rate to less than 
half of what it had been in previous years. 
They also found that faculty and super- 
visors reported fewer expressions of anxiety 
in the classroom and noted a pronounced 
decrease in tension in students’ relationships 
with patients and ward personnel. These 
studies, however, have limitations which 
make them difficult to interpret: (1) Com- 
parisons with appropriate control groups 
were not provided; hence it was not pos- 
‘sible to differentiate between the effects 
of the intervention procedure and of other 
factors such as normal personality develop- 
ment. (2) In Arbuckle’s study, no measures 
of the effects of the group experience were 
obtained outside of the orientation classes 
themselves. (3) In the Rosenberg and Ful- 
ler study, the seminars appeared to have 
profound effects on the entire school en- 
vironment since all first-year nursing stu- 
dents participated in them. Changes in 
the environment may well have produced 
the changes in the students’ behavior. 

The present study has five important fea- 
tures, several of which were designed to 
avoid the shortcomings noted in the prev- 
ious investigations with preventive features. 
(1) College freshmen whose anxiety test 
scores indicated that they might be under- 
achievers or academic failures were identi- 
fied shortly after their arrival on campus. 
(2) Group counseling with therapeutic pre- 
vention goals was initiated during the first 
semester with those anxious freshmen who 


volunteered to participate. (3) Group 
counseling was provided for only half of 
the students who volunteered, thereby per- 
mitting the comparison of the performance 
of counseled students with a control group 
of noncounseled volunteers. (4) Since less 
than two per cent of the total student body 
were participating in group counseling at 
any given time, it was unlikely that the 
college environment was greatly influenced 
by the counseling program. Thus, infer- 
ences concerning the effectiveness of the 
counseling procedures could be made on 
the basis of objective criteria of academic 
adjustment external to the counseling situa- 
tion. (5) Counseled students were com- 
pared to noncounseled students with re- 
spect to a number of uncontrolled variables 
which might be related to academic per- 
formance and which could serve, in the 
place of counseling, as alternative explana- 
tions for any obtained differences in aca- 
demic performance. 


Method 


Selection Instruments 

The American Council on Education Psy- 
chological Examination, 1949 Edition, 
(ACE) and a modified form of the Minne- 
sota Multiphasic Personality Inventory 
(MMPI) were administered to all freshmen 
entering Duke University in the fall of 1959. 
These tests were given during the week 
prior to the beginning of classes as parts 
of the university's regular placement test- 
ing program. The MMPI had been short- 
ened from 566 to 398 items so that it 
could be completed in the limited time 
available (14 hours). The modified MMPI 
included all of the items comprising the 
three validity scales, L, F and K; the nine 
original clinical scales; the Taylor Mani- 
fest Anxiety Scale (Taylor, 1953); and the 
Welsh Factor A Scale (Welsh, 1956). A 
biographical information card, which pro- 
vided data on the type of high school at- 
tended and whether or not the student 
had declared his major area of study, was 
also completed during the placement test- 


ing period. 
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Identification of Anxious College Freshmen 
Previous research had indicated that anx- 
iety scores for male college students may 
not have the same intellectual correlates 
(Spielberger, 1958) and may not be re- 
lated to nonintellective factors in the same 
way as those of female students (Weitz 
& Colver, 1959). Therefore, the sample to 
be offered group counseling was limited 
to entering male freshmen enrolled in the 
liberal arts curriculum. Since the original 
relationship between anxiety and academic 
performance had been obtained with the 
Taylor Manifest Anxiety Scale (MAS), 
scores on the MAS were given the most 
weight in determining which students 
would be offered counseling; but to insure 
the inclusion of students who were consist- 
ently high in maladaptive anxiety, the 
Welsh Factor A Scale (A-Scale) was also 
employed. The criterion established for the 
identification of anxious students required 
an individual to score in the upper 30 per 
cent of the MAS raw score distribution (16 
and above) and in the upper 50 per cent 
of the A-Scale raw score distribution (10 
and above). Of the students satisfying the 
anxiety criterion, those who scored below 
the fourth stanine on local ACE norms 
(raw scores of 104 and below) were elim- 
inated from the sample since previous re- 
search had indicated that students with low 
ability performed poorly regardless of their 
anxiety level (Spielberger, 1962). Of an 
entering class of 565 male liberal arts fresh- 
men for whom data were available, 112 
met the combined anxiety and intellectual 
criteria. 
Assignment of Students to 
Counseling and Control Groups 


All students who met the selection cri- 
teria were invited by letter to participate 


. in a voluntary “academic orientation pro- 


gram.” They were told that the purpose 
of the program was to assist entering fresh- 
men adjust to college life so that they 
might more effectively utilize their educa- 
tional opportunities. It was further ex- 
plained that the program would be carried 
out through small discussion groups meet- 
ing once a week in which students would 


be encouraged to raise questions related 
to their own academic, vocational, personal, 
and social interests. Students wishing to 
take part were asked to return a completed 
schedule card and to commit themselves 
to participation for a minimum of four 
weeks, The latter requirement was insti- 
tuted because it was expected that mount- 
ing pressure from academic work coupled 
with possible arousal of anxiety in early 
sessions might cause some students to drop 
out before they recognized any of the pos- 
sible benefits of the program. Of the 112 
students invited, 56 volunteered and were 
assigned in equal numbers to an experi- 
mental-counseled group (E) and a non- 
counseled-control group (C) which were 
matched on factors found previously to re- 
late to academic performance in the uni- 
versity population. These included: ACE 
scores; type of high school attended (Weitz 
& Wilkinson, 1957); and declaration of a 
major field of study (Weitz, Clarke, & 
Jones, 1955). 

The present study was concerned ex- 
clusively with the effects of group coun- 
seling upon the academic performance of 
students who volunteered for the special 
orientation program. Therefore, two stu- 
dents assigned to the E group who did not 
attend a single counseling session and one 
student in the C group who dropped out 
of school early in the semester were elimin- 
ated from the final sample. 


The results of the matching procedures, 
excluding the data for the three students 
who figured in the matching but who were 
subsequently eliminated, are presented in 
Table 1. There were no statistically signifi- 
cant differences between the E and C 
groups on any of the matching variables. 
Although it was planned that the counsel- 
ing sessions would begin shortly after 
classes commenced, administrative and 
scheduling problems prevented their meet- 
ing until the sixth week of the semester. The 
assignment of midterm grades two weeks 
later afforded the opportunity to check the 
adequacy of the matching procedures di- 
rectly against a criterion of academic per- 
formance. It may be noted in Table 1 that 
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Table 1 
Mean Scores on the Matching Variables for the Experimental and Control Groups 
Expt. Group “Control Group Difference® 
Mean SD Mean SD 

Variable (N=26) (N=27) (Control-Expt.) 
% Private School 15.4 7.0 11.1 6.0 —4,3 
% Declared Major 19.2 8.4 25.9 8.4 6.7 
ACE 130.8 16.2 132.2 15.1 1.4 
Midterm GPA 2.12 45 2.20 59 .08 





aWhen evaluated by the appropriate t test or chi-square, none of the differences 


approached statistical significance. 


the midsemester grades for the E and C 
groups were well matched. 


Counseling Procedures 

Students in the E group were assigned to 
four counseling subgroups, each consisting 
of six to eight students, and notified by let- 
ter of the time and place that their counsel- 
ing groups would meet. The C group was 
told by letter that more students had volun- 
teered than could be worked with during 
the current semester, and that they would 
be offered an opportunity to participate in 
the program during the second semester. 
The group counseling was conducted with- 
in the administrative framework of the 
Duke University Bureau of Testing and 
Guidance. The two counselors were mem- 
bers of the university faculty; both had 
extensive previous experience in counsel- 
ing and clinical work with college students. 
Each of the counselors worked with two 
counseling groups. Students were encour- 
aged to bring up problems of any sort 
about which they were concerned. Topics 
most favored by the students included 
methods of study, individual academic dif- 
ficulties, vocational goals, dormitory life, 
relations with professors in class and on 
the campus, and to a lesser extent, matters 
relating to nonacademic difficulties and 
problems of personal identity. The coun- 
selors attempted to stimulate group discus- 
sion, to facilitate the utilization by the 
group of ideas presented by individual 
students, to provide relevant factual in- 
formation, and to summarize and clarify 
what was said. 

The number of counseling sessions with 


the four groups ranged from 8 to 11. One 
group terminated prior to the Christmas 
vacation period; the other groups met until 
the end of the semester. During the fourth 
group session, the students were given the 
Survey of Study Habits and Attitudes 
(Brown & Holtzman, 1955) and the Kuder 
Preference Record, Vocational. These tests 
along with the students’ placement tests 
were discussed during the fifth group meet- 
ing. All sessions were recorded on magnetic 
tape. A graduate student observer, who 
kept attendance and made behavioral ob- 
servations, met regularly with each group. 


Criterion Measures of 
Academic Adjustment 

Academic achievemen: provided the prin- 
cipal objective criterion against which the 
effects of group counseling were evaluated. 
Midterm and first semester grade-point 
averages (GPA’s) were obtained from uni- 
versity records for students in the E and 
C groups. The student's GPA is the 
weighted average of his academic perform- 
ance in course work where 4 points are 
credited for each hour of A, 3 for B, 2 for 
C, 1 for D, and 0 for F. Data were also 
collected on factors which might relate to 
academic performance and thereby provide 


alternative explanations for any obtained , 


effect of group counseling. The measures 
examined were class attendance, scores on 
the Survey of Study Habits and Attitudes 
(SSHA), and on the personality scales of 
the MMPI. Students in the E and C groups 
were interviewed as soon as possible after 
the end of the semester to gain information 
about their adjustment to college life. 
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Results 


The Academic Performance of 
Counseled and Noncounseled Students 


Because of the limited number of sub- 
jects, data for the four counseling sub- 
groups were pooled. The academic per- 
formance of the total E group was then 
compared with that of the C group. Since 
the counseling groups did not begin meet- 
ing until just prior to midterm and had 
comparable GPA’s at that time, improve- 
ment in GPA from midsemester until the 
end of the semester served as the principal 
criterion of the effects of counseling upon 
academic performance. The improvement 
in GPA obtained by the E group is com- 
pared to the improvement of the C group in 
Figure 1 in which the groups have been 
equated for midterm GPA’s. Both the E 
and C groups showed improvement in GPA. 

The statistical significance of the ob- 
tained improvement was evaluated by 
means of an analysis of variance (Lind- 
quist, 1953, Type I Design). The differ- 
ence between midterm grades and end of 
semester grades for both groups combined 
was found to be highly significant (F= 
23.37; df=1/51; P<.001). This improve- 
ment would appear to be attributable to 
university grading practices which regular- 
ly produce lower grades at midterm than at 


the end of the semester. Although slightly 
below the C group at midterm (see Table 
1), the E group showed greater improve- 
ment in GPA and by the end of the 
semester was performing at a higher level. 
The statistically significant interaction be- 
tween groups and grading period (F=6.63; 
df=1/51; P<.05) when considered along 
with Figure 1 indicates that the counseled 
students showed greater improvement in 
academic performance than the noncoun- 
seled students. 

The Relationship Between Number of 
Sessions Attended and Improvement in 
Academic Performance 


The finding of greater GPA improvement 
for the E group is consistent with the hy- 
pothesis that counseling led to the obtained 
improvement, but more confidence could 
be placed in this interpretation of the data 
if students who attended more counseling 
sessions showed more gain than those who 
attended fewer sessions. When change in 
GPA from midterm to the end of the semes- 
ter was used as the index of improvement, 
a Pearson r of .63 (P<.01) was obtained 
between number of sessions attended and 
GPA improvement. This positive relation- 
ship between attendance and grades was 
further evaluated by dividing the E group 
into three subgroups according to the num- 
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Fig. 1. The mean improvement in GPA from midterm to the 
end of the semester for students in the counseled group (E) and 
the noncounseled-control group (C). 
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Table 2 


Mean Midterm and Semester 


Grade Point Averages® for the 


Experimental and Control Groups 

















Midterm GPA Semester GPA 

Group N Mean SD Mean SD 
Control Group 27 2.20 59 2.85 63 
Experimental Group 26 2.12 45 2.43 4 
High Attenders 9 2.16 Al 2.75 44 
Middle Attenders 9 1.95 44 2.13 5D 
Low Attenders 8 2.27 .65 2.39 48 





aA student’s GPA is the weighted average of his academic performance in course work 
where 4 points are credited for each hour of A, 3 points for B, 2 points for C, 1 point 


for D, and 0 for F. 


ber of counseling sessions each student 
attended. The number of counseling ses- 
sions attended by students in the E group 
ranged from 2 to 11; the mean number of 
sessions attended was 6.7. Students who 
attended 2—5 sessions were designated Low 
Attenders; those who attended 6~—7 ses- 
sions were designated Middle Attenders; 
those who attended 8—11 sessions were 
designated High Attenders. The Low, Mid- 
dle and High Attender groups consisted of 
eight, nine, and nine students, respectively. 
The means and SD’s of the GPA’s obtained 
by these groups for the two grading periods 
are presented in Table 2. The amount of 
improvement in GPA from midsemester to 


the end of the semester for the three at- 
tendance groups is compared with the im- 
provement of the control group in Figure 
2 in which the midterm GPA’s for the four 
groups have been equated. The evaluation 
of these data by analysis of variance (Type 
I Design) yielded a statistically significant 
interaction between groups and grading 
period (F=7.69; df=3/49; P<.01), which 
when considered together with Figure 2 
indicates that the High Attenders showed 
significantly greater improvement than the 
other groups. 

Although regular attendance at group 
counseling sessions was related to improve- 
ment in academic performance, this im- 
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Fig. 2. The mean improvement in GPA ‘from midterm 
to the end of the semester for High, Middle and Low At- 
tenders in the counseled group and for the noncounseled- 
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Table 3 


Mean Scores for the Three Attendance Groups on Variables 
Possibly Related to Academic Improvement 

















Variable High Attend. Middle Attend. Low Attend. F 
Mean SD Mean SD Mean SD 
(N=9) (N=9) (N=8) 
Ace 181.9 17.2 182.8 14.1 127.4 18.7 25 
% Private School Lil 10.4 11.1 10.4 25.0 15.3 * 
% Declared Major 22.2 8.1 REI 10.4 25.0 15.3 * 
Class Absences 5.2 4.7 11.1 9.4 55 4.4 2.23 
SSHA 33.2 11.1 84.68 8.8 82.3 4.4 .08 
MMPI Scales? 
Hs 57.5 9.6 57.3 7.1 58.4 14.4 .04 
D 57.2 11.7 63.3 12.8 60.3 11.1 30 
Hy 63.0 7.6 61.2 8.2 59.2 5.9 26 
Pd 58.1 11.2 64.3 8.1 57.9 8.7 1.13 
Mf 64.5 9.3 70.0 13.6 66.3 8.3 58 
Pa 58.5 8.5 725 7.8 58.2 9.9 .65 
Pt 65.0 49 64.8 8.2 66.4 14.6 12 
Sc 62.7 10.4 63.0 13.2 63.0 14.1 .04 
Ma 64.4 10.4 60.0 7.3 59.7 8.9 .07 
MAS 20.8 3.2 20.9 8.1 22.4 6.8 39 
A-Scale 15.7 6.7 19.7 4.9 17.8 6.6 .60 





*Cell frequencies were too small to permit meaningful statistical analysis. 
aData were available for only 4 Low and 7 Middle Attenders. 
bData are reported on T scores for all MMPI scales except the MAS and A-Scale where raw 


scores are reported. 


provement cannot be attributed to the ef- 
fects of counseling unless it can be demon- 
strated that factors which might account 
for regular attendance do not, in fact, also 
account for the obtained GPA improvement. 
Therefore, the High, Middle, and Low At- 
tenders were compared on available meas- 
ures which might be related to academic 
performance. The measures included the 
variables on which the E and C groups had 
been originally matched, and, in addition, 
class attendance, scores on the SSHA, and 
scores on individual MMPI personality 
scales. The means and SD’s for the three 
attendance groups on these measures are 
presented in Table 3. Analyses of variance 
(Lindquist, 1953, Simple Randomized De- 
sign) for each of these measures failed to 
yield a single significant difference among 
the attendance groups. 
Comparison of High Attenders with 
Personality-Matched Controls 

Although no single personality measure 
was found to be related to attendance at 
counseling sessions, it was still possible that 


the High Attenders were characterized by 
a personality syndrome which determined 
their regular attendance at counseling ses- 
sions as well as their improvement im aca- 
demic performance. To evaluate this al- 
ternative interpretation of the data, it was 
first necessary to demonstrate that a person- 
ality pattern which uniquely characterized 
the High Attenders could be isolated. The 
academic performance of High Attenders 
could then be compared with a group of 
noncounseled anxious volunteers who pos- 
sessed these same personality characteris- 
tics. 

The personality characteristics of High 
Attenders were isolated in the following 
manner: (1) K-corrected T scores for each 
of the nine MMPI clinical scales were ob- 
tained for the students in the E and C 
groups; (2) personality profiles which con- 
sisted of a student's three most highly 
elevated scales were determined for each 
student; (3) personality ‘criteria which 
differentiated the High Attenders from the 
Middle and Low Attenders were derived 
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Fig. 8. The mean improvement in GPA from midterm to 
the end of the semester for students who regularly attended 
the counseling sessions and for students selected from the 
control group (Matched Controls) on the basis of personality 
measures which tended to uniquely characterize the High 


Attenders. 


through comparisons of the profiles of stu- 
dents in the three attendance groups. It 
may be noted in Table 3 that scales Ma 
and Hy are the only MMPI clinical scales 
whose means tend to show a linear, albeit 
nonsignificant, relationship with attend- 
ance. For 8 of the 9 students in the High 
Attender group, either scale Ma, or scale 
Hy but not scale Mf, appeared among the 
students’ three most elevated scales. Only 
2 of 9 Middle Attenders and 3 of 8 Low 
Attenders had these profile patterns. Al- 
though this procedure for determining the 
personality patterns of High Attenders is 
admittedly post hoc and capitalized on 
chance factors, it served to isolate empirical 
personality criteria which were relatively 
unique for the High Attenders. 

There were 9 students in the control 
group whose MMPI profiles fitted the per- 
sonality criteria established for the High 
Attenders. The mean GPA’s at midsemester 
and at the end of the’ semester for these 
noncounseled students who were personal- 
ity-matched with the High Attenders were 
2.19 and 2.43, respectively. In Figure 3 the 
amount of GPA improvement of the High 


Attenders is compared with that obtained 
by the personality-matched controls after 
these groups were equated for midterm 
grades. When these data were evaluated by 
analysis of variance (Type I Design), the 
finding of a statistically significant groups 
by grading-period interaction (F=6.87; df 
=1/16; P<.025), when considered together 
with Figure 3, indicates that students who 
regularly attended group counseling ses- 
sions showed greater improvement in GPA 
than personality-matched noncounseled 
controls. 


Discussion 


The results of the present study indicated 
that anxious college freshmen who volun- 
teered for and regularly attended group 
counseling sessions showed significantly 
more improvement in academic perform- 
ance than anxious freshmen who either did 
not regularly attend group counseling or 
who were not offered this opportunity. The 
greater improvement in academic perform- 
ance of High Attenders could not be ac- 
counted for in terms of scholastic ability, 


study habits and attitudes, class attendance, 
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type of high school attended, or declaration 
of a major area of study. Nor did High At- 
tenders differ from Middle and Low At- 
tenders on any of the MMPI clinical scales. 
It was possible, however, to isolate per- 
sonality patterns which tended uniquely to 
characterize High Attenders. But when the 
academic performance of High Attenders 
was compared with noncounseled students 
who possessed these same personality char- 
acteristics, the latter did not show academic 
improvement comparable to that obtained 
by the High Attenders. Therefore, it would 
seem reasonable to conclude that although 
personality characteristics of High Attend- 
ers may have accounted for their regular 
attendance at group counseling sessions, 
participation in group counseling provides 
the best explanation for the improvement 
in their grades. 

Interviews with 23 of the 26 counseled 
students were conducted at the beginning 
of the second semester. These students 
were asked what benefit, if any, they had 
derived from the group sessions. Their most 
frequent responses were that the “discus- 
sion groups” had helped them to improve 
their study habits and to learn to use their 
time more effectively. The students also 
felt that it had been useful and interesting 
to hear views expressed by peers, and to 
learn that other students had problems 
similar to their own. On one topic there 
was nearly complete agreement; the stu- 
dents felt that the counselors’ interpreta- 
tions and the group discussion of the apti- 
tude and interest tests had been worth- 
while and helpful in contributing to a bet- 
ter understanding of themselves. Participa- 
tion in the group discussions was also felt 
by some of the students to have contributed 
to a better understanding of their own per- 
sonal problems. 

Since students who participated in the 
counseling groups had been invited to do 
so on the basis of high anxiety scores, it 
was expected that a significant portion of 
the counseling sessions would focus upon 
experiences which had induced anxiety in 
these students prior to their entering col- 
lege. But this did not occur despite the 


counselors’ biased expectations and their 
overt encouragement of the students to 
discuss their personal problems. Instead 
the students were concerned almost ex- 
clusively with anxiety-arousing aspects of 
their present environmental circumstances, 
e.g., difficult course work; inability to 
study; low social status of freshmen; at- 
titudes of professors; aggressive and noisy 
roommates. Although there was ample ob- 
servational evidence of a high level of mani- 
fest anxiety in the behavior of these stu- 
dents, either they did not feel the need to 
discuss precollege antecedents of their 
anxiety or they did not feel the counseling 
groups a safe enough place to do so. In 
any event, group discussions with anxious 
college freshmen about the anxiety-arous- 
ing aspects of their academic environment 
appeared to facilitate the academic per- 
formance of those who regularly partici- 
pated in the counseling sessions. But only 
half of the students invited to participate 
in the counseling groups volunteered to do 
so, and only a third of those who volun- 
teered attended a sufficient number of 
sessions to benefit from the program. These 
facts clearly indicate that, for most anxious 
college freshmen, group counseling may not 
be a generally applicable procedure for the 
therapeutic prevention of underachieve- 
ment or academic failure. Group counsel- 
ing may be of value only for those students 
who possess personality characteristics 
which make it possible for them to partici- 
pate fully and thereby benefit from such 
counseling. . 
Suggestive information bearing on the 
personality characteristics associated with 
being helped by group counseling was 
available in the MMPI data obtained in 
the present study. The High Attenders may 
be tentatively described as “active-repress- 
ive” on the basis of their MMPI profiles. 
The Ma scale was the single most frequently 
elevated scale for students in this group; Hy 
followed in terms of the frequency of oc- 
curence among the three most elevated 
scales in individual student profiles. The 
MMPI profiles of the High Attenders were 
consistent with observations in the coun- 
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seling sessions that these students tended 
to repress disturbing feelings and antisocial 
impulses, and appeared to seek solutions 
to their problems through active inter- 
action with the environment. Markedly dif- 
ferent profiles were obtained for the Mid- 
dle and Low Attenders. The Middle At- 
tenders were labeled “passive-rebellious 
with concern about rebellious tendencies” 
since scales Mf, Pd, and D were most fre- 
quently found among the elevated scales 
for individual students in this group. For 
the Low Attenders, scale Mf was most fre- 
quently elevated, followed by Sc and Pt, a 
pattern which was called “passive, with- 
drawn and ruminative.” The personality de- 
scriptions applied to the Middle and Low 
Attenders were also consistent in a general 
way with the behavior of these students 
in the counseling groups and their attend- 
ance paiterns. 


Summary 

College freshmen with high anxiety 
scores were invited to participate in coun- 
seling groups designed to help them make 
more effective adjustments to college life. 
Of the students who volunteered, half 
were seen weekly in group counseling ses- 
sions during their first semester; the other 
half served as a control group. Improve- 
ment in academic performance from mid- 
term to the end of the semester was the 
principal criterion of academic adjustment. 

Those anxious freshmen who regularly 
attended group counseling sessions showed 
more improvement in their academic per- 
formance than students who were not 
counseled or who did not regularly attend 
counseling. Although it was possible to 
isolate a personality pattern which rela- 
tively uniquely characterized the students 
who regularly attended the counseling ses- 
sions, participation in group counseling ap- 
peared to be the most likely explanation for 
the improvement in grades obtained by 
these students. 
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Client-Centered Developments and 


Work with Schizophrenics 


Eugene T. Gendlin’ 
University of Wisconsin 


This paper is an early descriptive report 
on psychotherapy with schizophrenics in 
a research project sponsored by Carl R. 
Rogers. The project employs many psycho- 
metric and interview measures, a matched 
control group, and complete tape record- 
ings of the therapy interviews. The project 
is not yet completed and hence it is not 
yet established that effective psychotherapy 
is taking place. Meanwhile much is being 
clinically observed and learned. Therapists 
are modifying the client-centered way of 
doing therapy. 

The paper will trace these developments 
in terms of the trends and theories of the 
client-centered orientation, but clearly, 
what is occurring is related to a wider 
context of present trends in the field of 
psychotherapy generally. I will therefore 
begin by quoting some writers outside the 
client-centered crientation, whose descrip- 
tions of their practice indicate at least three 
trends which are shared by several orien- 
tations: increasing emphasis on (1) the 
personal relationship; (2) the therapist's 
spontaneity and genuine expressiveness; 
(3) the subverbal, affective, preconceptual 
nature of the basic therapeutic communica- 
tion. Fromm-Reichmann (1959) writes: 

The doctor should offer his presence to lonely 
patients, first in the spirit of expecting nothing 
but to be tolerated, then to be accepted simply 


as some person who is there. The possibility 
that psychotherapy may be able to do something 


1The project was supported by the Society for 
the Investigation of Human Ecology and the 
Wisconsin Alumni Research Foundation. Cur- 
rently it is supported by the National Institute 
of Mental Health. The project is being carried 
out at Mendota State Hospital, Madison, Wis- 
consin, with the collaboration of W. J. Urben, 
Superintendent, and G. Tybring, Clinical Director. 


about the patient’s loneliness should, of course, 
not be verbalized at this point. To offer any 
such suggestion in the beginning of one’s contact 
with an essentially lonely patient could lend itself 
only to one of two interpretations in the patient’s 
mind: Either the psychotherapist does not know 
anything about the inextricable, uncanny quality 
of his loneliness, or he himself is afraid of it. 


Whitehorn writes: 

B physicians (unsuccessful with schizophrenics) 
had a tendency either to be passively permissive 
or to point out to a patient his mistakes and 
misunderstandings . . . whereas the A physicians 
(successful with schizophrenics) did little inter- 
pretation or instruction, but did express personal 
attitudes fairly freely on problems that were being 
talked about by the patient, and did set limits 
on the kind and degree of obnoxious behavior 
permitted. 

Whitaker, Warkentin and Malone (1959) 
write: 

Nonverbal communication is of primary im- 
portance. The patient must avoid intellectual 
verbiage, lest it be a barrier to the unconscious- 
to-unconscious affective relationship between 
therapist and patient. 

Silence as such can be a valuable medium for 
the conduct of the communication between thera- 
pist and patient. 

The therapist is not simply a projective screen 
but an active participant in a person-to-person 
relationship in which he participates with as few 
technical maneuvers as possible. The therapist’s 
effort is to communicate as fully as possible his 
feeling responses to the presence of the patient, 
and his experiences in this relationship. 

The trends of current client-centered 
therapy to some extent resemble the ob- 
servations of the above-quoted authors and 
of others. Thus, this paper will report much 
that is not new. On the contrary, the 
very recurrence of similar experiences and 
methods in different orientations would 
seem to point toward phenomena that de- 
serve attention. In the observations of these 
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authors, and, as I shall report, in our own 
observations, effective psychotherapy with 
schizophrenics appears to be a largely 
personal, expressive, and concretely experi- 
ential or subverbal process. 


Changes in the Client-Centered Approach 
Prior to Its Application with Schizophrenics 


Before I can report the most recent de- 
velopments in client-centered therapy, I 
must report, the trends and changes in 
method which were already occurring a 
few years ago, before the research with 
schizophrenics began. At that time, along 
with most other orientations, client-cen- 
tered therapy was becoming less sectarian, 
less formal, more personal, more concerned 
with feeling and immediacy than with 
verbal content or verbal reflection. 

Three lines of modification, especially, 
were already being made at that time: 

1. Seeman (1956) and a number of 
others found fault with the description of 
the client-centered response as a “reflection 
of feeling.” In various ways the range of 
therapist response behavior was being 
widened. Rogers (1957, 1959), especially, 
widened the scope to include as therapeutic 
all modes of responding which could mani- 
fest three basic therapeutic attitudes: “em- 
pathic understanding,” “unconditional posi- 
tive regard,” and “genuineness.” An un- 
limited range of therapist behavior might 
implement and communicate these atti- 
tudes. Rogers hypothesized that therapy 
would take place if these attitudes were 
present and communicated to the client. 
Thus basic therapist attitudes, rather than 
any specific “client-centered” behaviors, 
were thought to be the essential thera- 
peutic factors. 

2. In a second line of modification dur- 
ing the last few years; Butler (1958) and 
others held that therapist spontaneity is 
related to success in therapy. Rogers formu- 
lated as one of the three basic therapeutic 
attitudes that “the therapist is congruent 
(genuine) in the relationship.” Of course, 
genuine expressiveness does not mean that 
the therapist spends most of the hour ver- 
balizing each of his own feelings (most 
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often he would be genuinely experiencing 
the client’s expressive behavior ). However, 
there has been a striving for undefensive 
transparency and genuineness of the thera- 
pist as the person he is, free of professional 
or personal artificiality. 

3. A third modification was the increas- 
ing tendency (Gendlin & Zimring, 1955; 
Hart, 1961; Rogers, 1959) to view therapy 
in the client as consisting of feeling events, 
rather than conceptual insights. The theory 
of “experiencing” (Gendlin, 196la; 1962) 
emphasized that one moment’s concrete 
feeling process could implicitly contain 
many psychological contents. It might be 
impossible to conceptualize all of these, 
yet the client can feel them all as a directly 
sensed referent within himself. Therapeutic 
responses aid the client to refer directly 
to his present feeling process, and to maxi- 
mize and intensify this process (Rogers, 
1959). The interactive conditions of the 
therapy situations were seen as constituting 
new experiencing of a fuller, more im- 
mediate manner (Gendlin, et al., 1960). 

As I shall now show, these three earlier 
lines of modification in the client-centered 
approach have grown to be the major 
characteristics of therapy with schizo- 
phrenics. 


Client-Centered Therapy in Its 
Application with Schizophrenics 


Characteristic Client Reactions 

What is it, in the schizophrenic in- 
dividual’s response to psychotherapy, that 
has so accelerated just these already .in- 
cipient lines of development? I will 
mention four well-known characteristics of 
the way in which many schizophrenic in- 
dividuals respond to psychotherapy: 

“Nonmotivation.” Clients were selected 
according to criteria of the experimental 
design — age, sex, social class, length of 
hospitalization, degree of disturbance — as 
crosscutting variables. When two individ- 
uals who matched each other on all these 
variables were found, a coin was flipped 
to determine which was a no-therapy con- 
trol, and which would receive therapy. 
This method obviated the more usual se- 
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lection for therapy. Usually individuals who 
are responsive to staff and become known 
to them are assigned to psychotherapy. In 
this way motivated people most often select 
themselves. We expected and desired a 
group of clients whose prognosis would 
not be biased favorably by such self-selec- 
tion. We more than accomplished this aim! 

The majority of the clients who were se- 
lected for therapy did not desire it, resisted 
it, often refused to meet the therapist, and 
made it difficult for therapy to begin or 
to continue (Gendlin, 1961b). 


Silence. The second characteristic reac- 
tion, encountered with the majority of these 
clients, was silence. This was not the oc- 
casional periods of silence which we as- 
sociate with deep therapy, but continuing 
silence, interview after interview, often for 
the whole interview with the exception 
of a few sentences. 


“Nonexploration.” A third characteristic 
concerns the nonexploratory, often non- 
inward character of what is said. The 
verbal therapeutic process often seems ab- 
sent. Often there is a refusal to own feel- 
ings explicitly, even though they are just 
then being implied. There is a high degree 
of externalization. Problems and interests 
are located in others and in external cir- 
cumstances.” 

Even when there are brief periods of 
seeming self-exploration, or of deep verbal 
communication, these do not go to make 
up a continuing process. The next meet- 


2In this respect these schizophrenic clients re- 
semble the clients who usually fail in client- 
centered therapy according to the accurate pre- 
dictions of the studies with the Kirtner Scale 
of first interview ratings (Kirtner & Cartwright, 
1958). The failure-predicting end of the scale 
indicates external location of problems and lack 
of inward exploration. 

Another group of individuals who usally pose 
difficulty for client-centered therapy are the 
parents described by Ellinwood (1959), who 
bring their children to play therapy and seek 
help for themselves also, but do not want or 
expect this help to be psychotherapy. 

If the developments in psychotherapy with 
schizophrenics, described here, are successful, 
they may apply also to these groups of clients 
and to many others. 


ings may again be barren of deep verbal 
communication, as if nothing had hap- 
pened. The person does not seem to be 
engaged in an exploration of his own to 
approach his subjective problems. Verbally, 
there is irregular and nonexplorative emo- 
tional expression. 


Intense subverbal interaction. A fourth 
characteristic is the intensity of subverbal 
interaction. It often seems that the in- 
dividual has given up the niceties of civi- 
lized society, and of verbal or consensual 
checking. Subverbal impressions guide him. 
If it is his impression that the therapist's 
face reflects a dislike, a disturbance, a re- 
jection, his response is instantanéous and 
likely to be total. For example, when I 
hesitate for a moment in the midst of 
saying something, my client waves me 
away. It is as if all in an instant my 
ambivalent, semiunconscious difficulty in 
formulating my message is sufficient for 
him to back away from it. Slight move- 
ments on either of our parts constitute 


an intense subverbal conversation. Early 


in therapy my interest and curiosity in 
him is often visibly hard for him to bear. 
More verbal later on, he can say: “Your 
ears are too big,” or less dramatically, “I 
don’t know if I should say anything or 
not. You're too curious.” In many inter- 
actions I cannot know whether what I 
subjectively live with the client is anything 
like what he feels, but I know that we 
are engaged in an eventful and deeply felt 
subverbal interaction. 


Therapist Attitudes 


As I mentioned earlier, the client-cen- 
tered method is no longer defined in terms 
of specific techniques or modes of response, 
but rather in terms of certain basic attitudes 
(Rogers, 1957, 1959). Many different orien- 
tations, techniques, and modes of therapist 
response could manifest these attitudes. 
Therefore, the attitudes I will now describe 
are not limited to client-centered therapy, 
yet they alone define “client-centered 
therapy.” 

The therapist who endeavors to share 
the psychotic client’s perceptions and feel- 








208 


ings sees little therapeutic value in ex- 
planatory concepts. These do not help him 
reach the individual’s own experiencing. 
Because the hospitalized person is so often 
“administrated,” his case “disposed” in 
some way, without much reference to his 
own experiencing, there is a tendency to 
discuss him in terms of diagnostic ex- 
planatory concepts. In terms of such con- 
cepts we have generalized knowledge. In 
contrast, the therapist who endeavors to 
be “empathic” focuses his attention on the 
individual's own experiencing, in so far as 
the therapist can sense it. 

2. Often in a hospital setting the be- 
haviors, * aggressions, manifest symptoms, 
and act-outs become all-important foci of 
attention. The hospitalized client is often 
punished or corrected. The therapist, on 
the contrary, seeks to perceive with the 
client on the client’s side (becomes his 
“lawyer,” as Betz and Whitehorn [1956] 
suggest), and has a warm “regard” for 
him as a person. It is just as true of 
psychotics as of others that as one gets 


to know the person more deeply one likes 


him very personally, if concerns with out- 
side factors do not interfere. 

3. In a hospital setting there is a re- 
markable isolation of the client. Not only 
are his interpersonal contacts narrowed 
physically, but his contacts are also quali- 
tatively limited, since often he is not re- 
sponded to at face value. His words are 
often not taken as a serious message from 
a person. Similarly, it is common for pro- 
fessional people to withhold their own 
actual responses and to substitute some 
professionally appropriate stock response. 
In contrast, if the therapist attempts to be 
“genuinely” himself, and_ self-expressive, 
then he is foremost a human being capable 
of shattering the schizophrenic’s isolation; 
he brings a direct human contact. And, 
although the schizophrenic may not be able 
to meet this human approach, he has never- 
theless in the therapy situation an equally 
human role. He may fill this role or leave 
it empty, but it is constantly present as 
a fully human role. 

How These “Therapist Attitudes” Initially 
Make the Characteristic Client Reactions 
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More Especially Noticeable. The hurt and 
isolation of schizophrenics generally, and 
the nonvoluntary way in which these clients 
were assigned to psychotherapy, would 
account for their characteristic refusals, 
silences, and absence of verbal exploration. 
Yet I think the attitudes of these therapists 
also tended to bring out more strongly 
just such reactions, and thus led to modifi- 
cations in the mode of psychotherapy. 

A therapist who is accustomed to initiat- 
ing therapy by responding to the client’s 
motivations and feelings is sure to be 
strongly affected by the client’s unwilling- 
ness to meet with him. Such a therapist is 
sure to feel temporarily deprived of the 
basis upon which he works. 

Similarly, a therapist whose main focus 
is to share the client’s actual subjective 
experiencing—a therapist who cares little 
for external explanations and _ behavioral 
corrections—is most likely to note, as a 
striking characteristic, the client’s lack of 
subjective focus. 

The therapist who is accustomed to aid- 
ing self-exploration by empathic response 
will also be especially struck, and put at 
a loss, by the great amount of subverbal 
communication. This is just the sort of 
communication with which he is trained 
to empathize, yet the psychotic individual 
often does not intend to explore — or ver- 
bally formulate — these communications. 
As the therapist attempts to understand 
verbally, the client withdraws the more. 

The therapist who is accustomed to value 
the client’s frequent private search within 
himself is not likely to interrupt silences. 
Naturally, he finds that silences stretch 
into the whole hour and sequences of 
hours. 

I believe that therapists with other 
methods also encounter the client reactions 
I described, but perhaps they would not 
seem as striking as they do when viewed 
in terms of the client-centered approach. 


The Need for Modification 
of Therapist Behavior 

It might be simplest to describe our 
experiences by saying that when therapy 
did not seem to be going well, the therapists 
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felt a need to alter their modes of approach. 
First there are the conflicts that occur in 
the therapist because of these characteristic 
patient reactions, conflicts which make it 
impossible for the therapist to retain his 
customary attitudes. He comes to feel quite 
nontherapeutic and seeks ways to alter 
the situation so as to restore within himself 
his more familiar therapeutic attitudes. He 
must find different behaviors so as to regain 
the same attitudes which he is accustomed 
to as therapist. But the obvious alternative 
ways of behaving also do not restore his 
own old attitudes. The result is a process 
(still going on here) of sensitively evolv- 
ing quite new alternatives of therapeutic 
respondings where there previously ap- 
peared to be no good alternatives. 

There are three stages in this process. 


Awareness of Conflict 

The client is silent, or talks of trivia. 
Attempts to verbalize his implicit com- 
munications make him angry, fearful, or 
withdrawing; or, as we try to respond to 
a deeper level of feeling, we find that 
the client simply has not meant to look 
at himself more deeply — and misunder- 
stands us. We have all sorts of impressions 
and images of what the client feels, since 
subverbally he does communicate. We 
wonder what to do with all this richness 
of events which occurs in our own moment- 
to-moment experiencing, as we sit quietly 
or converse superficially. We feel much 
empathy but can show little. As we go 
along on a casual level, or in silence, we 
wonder if we aren't allowing ourselves to 
be just as helpless as this fearful person. 
We are in conflict, not knowing whether 
to push harder or to attempt being even 
safer. We blame ourselves for too much 
helpless waiting, then, minutes later, for 
too much interruption, pressure, and de- 
mand. We wonder whether the client is 
doing anything significant with us, whether 
we are failing him. We become impatient 
and angry at giving so much inward re- 
ceptivity while so little of it seems com- 
municated. We value deeply what little 
or trivial communication he gives us, and 
we do not want to push that away. Yet 


we feel dishonest when we seemingly 
assent to silence or to this trivial level 
of communication. Obviously, in such a 
condition, we feel quite unfamiliar to our- 
selves as therapists. In order to attempt to 
restore the inward condition we are fa- 
miliar with as being therapy, we come to 
behave in unfamiliar ways. 


The Try-Out of Ready Alternatives 

The client refuses to meet with the thera- 
pist. Shall he be coerced, or should the 
relationship be allowed to end before it 
has really begun? Neither alternative is 
acceptable. The therapist goes to meet the 
individual on the ward (coercion of a sort), 
but leaves him free to walk away. Now 
the client’s participation does not commit 
him, nor does his walking away constitute 
a committed refusal. The therapist will 
visit again later in the week, and will do 
so explicitly because he wants to. This 
leaves the client’s end of the relationship 
indeterminate until he determines it. The 
therapist states his own desire to meet with 
the client, his interests and feelings in 
this regard, in spite of negative reaction 
or lack of reaction. Certainly, the therapist 
in these ways takes more of the initiative 
than he usually would. Yet he attempts 
to find modes of taking initiative which 
are based on his own feelings, and which 
do not take the place of those initiatives 
which might later arise in the client. It 
is a peculiar and subtle resolution of the 
dilemma. In certain respects the therapist 
takes more initiative (for himself), yet in 
other respects he takes less initiative than 
ever (for the client). Not even the client’s 
commitment to try to form a relationship 
is assumed, or demanded. 
New Modes of Behavior 

The same trend of more expressiveness 
with less imposition applies not only to 
our mode of initiating psychotherapy, but 
also to our whole way of working during 
psychotherapy. We find that even when 
we cannot know what the client is think- 
ing and feeling, we can respond to him. 
If he is silent, I, as therapist, may be quite 
in the dark as to what he is thinking and 
feeling. I only know what I am thinking 
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and feeling, and how I imagine him. As 
I express my present feeling and my vague 
images of what may be happening between 
us now, a very personal quality enters into 
my expressions. I am giving words to my 
ongoing experiencing with him. There is 
a quality of personal risk and openness in 
my saying these things. There is a quality 
of gentle closeness in giving directly of 
my imaginings and feelings. In expressions 
I often state also my intention in saying 
what I say, and my unsureness concerning 
what is happening in him. I clearly say: 
“this is what is happening in me now,” 
or “this is what I imagine is happening in 
you (or between us), but I can’t be sure.” 
The client lives in a responsive context 
made up of my person and my openly 
expressive interaction with him. Yet, his 
side of the interaction may be quite tenta- 
tive, implicit, until he wishes to make it 
explicit as his. 

Similarly, the externalizing, event-report- 
ing client stirs in me many feelings for 
him, and images of him. I desire to hear 
from him more deeply, welcome him more 
personally. I can say this, and say it at 
every juncture at which I particularly feel 
it. In his descriptions of incidents, I sense 
him involved in many ways. I can express 
these (as imaginings of my own). I come 
to have more, and more often, a sense 
of the person he is which he omits from 
his reports of events. I become the one 
who expresses the feelings, who complains, 
cries, justifies, understands the private side 
of things which is misunderstood. I gently 
express my bafflement or surprise at the 
dilemma he is in. But these are my ex- 
pressions as an open and expressive person. 

I express myself in a fashion (and this 
takes a few steps of self-attention each 
time) which clearly states my feeling (not 
some judgment or deduction) and is based 
on my feelings for him and my desire to 
be close to him. As with the silent person, 
so also with the event reporter, I give 
voice to what I experience or imagine in 
him or in the events he reports. I voice it 
as my momentary inward process as we 
interact. One might say that these therapists 
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frequently establish and continue relation- 
ships by means of expressing themselves 
openly and genuinely. This procedure 
seems to leave the inarticulate and fearful 
person free, yet gives him a relationship 
at a time when he still cannot do much 
to form or maintain one. 


Theory 

The relatively subtle changes in emphasis 
which constituted modifications in the 
client-centered approach prior to its appli- 
cation with psychotics have become major 
observable developments. To conclude this 
report, I want to draw them together. The 
three directions of modification I mentioned 
were: (1) attitudes, rather than client- 
centered behavior, as therapeutic factors; 
(2) genuine expressiveness of the therapist; 
(3) experiencing (the preconceptual feel- 
ing process) constitutes therapy, rather 
than verbal self-exploration. In a theoretical 
formulation just brief enough to suit this 
early stage of observation, I might formu- 
late these three directions in one formula: 
The therapeutic attitudes (1 above) mani- 
fest themselves in interactive behaviors 
through genuine therapist self-expression 
(2 above), and this open interaction itself 
affects the nature of the client’s present 
experiencing process (3 above) so that in 
spite of threat and withdrawal he may 
find his experiencing occurring more op- 
timally and in interaction. 


Some Open Questions 


Complete research results must be 
awaited for the experimental and matched 
control groups, before we can know 
whether effective psychotherapy with 
schizophrenics is taking place. The present 
paper is therefore a report of current prac- 
tice. The evaluation of its effectiveness is 
still an open question. 

Psychotherapy generally, with any type 
of population, seems to involve not only 
verbalization, but more fundamentally, the 
client’s inward reference to, and struggle 
with, his directly felt experiencing. The 
individual's inward data, concretely felt, 
seem to be the actual stuff of psycho- 


therapy, not the words. It may be especially 
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true for the schizophrenic, but it seems 
true for everyone, that felt experiencing is 
meaningful in a preconceptual rather than 
only a conceptual way. Felt experiencing 
can be endlessly differentiated and con- 
ceptualized, yet it is concrete and never 
really consists of words and concepts. 
The schizophrenic may show this es- 
pecially, since he is so often lost and self- 
less, and the preconceptual meanings of 
his experiencing at first seem to him so 
removed from other persons and so 
incommunicable that silence or a few 
nonlogical words are the only possible 
expression. Very often one can see that 
his few statements arise from a very event- 
ful, concretely felt process — and that the 
interactions with the therapist are affecting 
or enabling this process. In principle, psy- 
chotherapy generally and, not only with 
schizophrenics, may be considered funda- 
mentally as a process of felt experiencing 
in the context of interpersonal responses. 
If that is correct, the client and therapist 
process described in this report would be 
in the most basic sense the same as that 
which occurs in any psychotherapy. 


Received October 15, 1961. 
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Comment 


Many people have been awaiting with 
interest an article of this kind. We have 
known that Rogers and his colleagues were 
working in therapy with schizophrenic per- 


sons. It was intriguing to speculate about 
the developments in therapy method which 
were emerging from the crucible of this 
experience. 
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Gendlin has given us the initial answers 
to this question. Some of the answers may 
seem baffling. What Gendlin describes is in 
some respects an exact mirror image of 
client-centered therapy as it has usually 
been known. One of the defining character- 
istics of client-centered therapy (indeed, 
the literal meaning of its title) lay in its 
emphasis upon the internal frame of refer- 
ence of the client. Gendlin portrays the 
counselor as attending at times, not to the 
client’s inner life but to his own. 

This would seem to be a strange reversal 
of emphasis. Yet the shift does not imply a 
change in therapeutic direction but only 
underlines the central continuities in thera- 
peutic theory. For the therapeutic relation- 
ship, if it means anything, means real com- 
munication between two people. One of 
the major tasks of the therapist is to restore 
the integrity of communication, which in 
the client has been shattered by experiences 
of danger from others. The therapist can 
do this best by communicating with im-' 
mediacy and integrity himself. This is what 
I think Gendlin is telling us here. The 
content or focus of communication may 
shift according to circumstance but the im- 
mediacy and genuineness are invariant. 

There are implications in all of this to 
which attention may usefully be drawn. 
One chief implication concerns the increas- 
ing awareness by counselors of the dif- 
ferentiation between the basic intentions 
of the therapist and the instrumental means, 
—i.e., the specific technical therapist be- 
havior—by which the intentions are realized. 
This is a useful distinction to make. Its 
practical untility lies in its implicit recogni- 
tion that different therapists are bound to 
develop personal response styles as differ- 
ent instrumental means to implement the 
same basic intentions. This is an especially 
important consideration for the person 
learning to be a counselor, because it frees 
him from the lockstep effect of learning a 
“therapeutic method” and fosters experi- 
mentation with personal ways of imple- 
menting basic hypotheses about therapy. 
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If Gendlin’s paper answered some ques- 
tions, it also served to heighten issues about 
which general agreement is some distance 
away. Gendlin pointed to some emerging 
commonalities among therapeutic ap- 
proaches in working with the psychotic 
person. These commonalities are useful to 
understand. It is equally important to main- 
tain our perception of the continuing dif- 
ferences among approaches, not because 
there is any virtue in “schoolishness” but 
because these differences may contain un- 
answered validity questions about therapy. 
One very lively issue implied in Gendlin’s 
paper is client-centered therapy’s continuing 
struggle to be nonintrusive. This character- 
istic has been one of the hallmarks of client- 
centered therapy. There was no issue in 
the earlier days when therapist involve- 
ment was low. But one of the more strik- 
ing developments in client-centered therapy 
has been its shift from detachment to in- 
volvement. Is it not difficult for a therapist 
to be highly involved and yet remain un- 
intrusive? I suspect that the client-centered 
therapist faces some real existential strug- 
gles around this issue. 


A final issue which remains to be re- 
solved is the place of cognitive processes in 
psychotherapy. The growing emphasis of 
client-centered therapy on immediate ex- 
periencing places the fulcrum of therapy at 
the preconceptual level. The role of cogni- 
tive reorganization thus becomes more pe- 
ripheral. This development is especially in- 
triguing because it emerges in the context 
of a theory built around the importance of 
the self concept, a construct which has 
strong cognitive undertones. My own 
thought on this issue is that the idea of 
preconceptual experiencing claims current 
emphasis as an emerging concept, but that 
the theory in the long run will revisit the 
cognitive realm and continue to view ther- 
apy as a blend of both affective and cogni- 
tive reorganization. 
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Appropriateness-of- V ocational-Choice as a 


Criterion of Counseling Outcome 


George G. Gonyea’ 
University of Texas 


In evaluating the effectiveness of various 
types of vocational counseling, one of the 
most popular and apparently straight-for- 
ward criteria has been some form of rating 
of the appropriateness of postcounseling 
vocational plans. In most cases the stated 
vocational objective is simply rated by 
experts on a scale of appropriateness-in- 
appropriateness or realism-irrealism, usually 
on the basis of interest and/or ability test 
data, sometimes with the aid of additional 
background information and/or school 
records (e.g., Apostal, 1960; Biersdorf, 
1958; Bilovsky, McMasters, Shorr, & Singer, 
1953; Hewer, 1959; Hoyt, 1955; Hutson & 
Webster, 1943). 

Results of these studies have been gen- 
erally favorable to counseling, though com- 
parisons between various counseling or 
guidance approaches have been equivocal. 
However, most of these studies have suf- 
fered from various methodological defects, 
of which some of the more serious have 
been the failure to control for appropriate- 
ness of initial, precounseling plans and the 
failure to provide adequate‘untreated con- 
trol groups. 


The Problem 


Over and above these difficulties in re- 
search design, however, is the question 
of criterion validity. Is the selection of an 
appropriate or realistic objective a neces- 


1This research was supported by a grant awarded 
to the University of Texas Testing and Counseling 
Center by the Hogg Foundation for Mental 
Health. Appreciation is expressed to David Sohn, 
research assistant, and to Nathan R. Altucher, 
Thomas B. Scott, Jack Spund, and Roy E. 
Warman, who made the various ratings of voca- 
tional appropriateness. 


sary or even a desirable goal for vocational 
counseling? If so, are ratings made by 
experts on the basis of test data or similar 
information valid measures of the appro- 
priateness of an occupational choice in 
terms of ultimate vocational success and/or 
satisfaction? How likely is it that the client 
will actually enter the occupation he avow- 
edly selects at the end of counseling? Even 
if he does not, how much of his eventual 
choice can reasonably be attributed to 
counseling? Similarly, can counseling be 
credited for any part of the subsequent 
vocational development of clients for whom 
counseling was apparently inconclusive or 
incomplete? 

One answer to most of these questions 
lies in the development and use of ultimate 
criteria. However, there is much to be 
said in favor of immediate criteria. Cer- 
tainly they expedite counseling outcome 
research. For example, attrition of client- 
research subjects is a function (probably 
geometric) of the time elapsed between 
termination of counseling and gathering 
of outcome data; moreover, this attrition 
is probably selective, thus complicating al- 
ready complex sampling problems. Obvious- 
ly, this difficulty can be minimized by 
obtaining outcome data immediately after 
counseling. Another advantage of the im- 
mediate criterion is that effects noted 
immediately or soon after treatment can 
more reasonably be attributed to treatment 
than those observed considerably later. 
Finally, if one of the practical aims of 
applied counseling research is to modify 
counseling procedures in light of measured 
effectiveness, then the sooner such measures 
can be obtained, the sooner they can be 
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acted upon. However, the use of such 
criteria is justified only insofar as these 
are valid measures or valid predictors of 
meaningful counseling outcomes. 

It is worth noting that all of the prob- 
lems raised here in connection with the 
evaluation of vocational counseling are 
strictly analogous to problems arising in 
research on psychotherapy, as recently 
reviewed by Zax and Klein (1960). In 
either case, it seems, an important early step 
should be the development of outcome 
criteria obtainable as soon after treatment 
as possible, and such measures must be 
validated against more ultimate follow-up 
observations.” This paper reports an attempt 
to validate and otherwise explore the mean- 
ing of the appropriateness-of-vocational- 
choice criterion described in the opening 


paragraph. 
Procedure 


The present study was based on data 
from 227 former clients of the University 
of Texas Testing and Counseling Center 
who terminated vocational counseling dur- 
ing the 1958-59 school year. In general, 
this sample was fairly representative of 
clients of the Testing and Counseling 
Center, but differed from the total uni- 
versity population in that freshmen, liberal 
arts students, engineering students, and 
men-in-general were somewhat over-repre- 
sented. 

Following a brief preliminary intake 
interview, client-subjects were assigned 
essentially at random to one of 13 staff? 


2This brief discussion necessarily omits, but 
does not discount, problems of reliability and 
dimensionality of outcome measures. These areas 
have been considered in some detail by Hewer 
(1959), Zax and Klein (1960), Cartwright and 
Roth (1957), Nichols and Beck (1960), and others. 
The criterion problem in vocational counseling 
was discussed in an early review by Williamson 
and Bordin (1941). 

3Some effort was made to assign “difficult” 
cases to more experienced counselors; however, 
chi square analyses of client sex, classification, 
college, appropriateness of precounseling vocation- 
al plans, and certainty of precounseling vocational 
plans yielded no significant differences between 
counselors. 
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counselors or interns. The number of inter- 
views per client ranged from 1 to 13, with 
median and mode both at 2. 

Three statements of vocational plans 
were obtained for each S. Precounseling 
vocational objectives were listed in a Basic 
Information Form completed routinely by 
clients before counseling. Postcounseling 
vocational objectives were ascertained from 
the counselor's final case notes. A brief 
follow-up questionnaire mailed out ap- 
proximately one year after termination of 
counseling provided a third vocational 
objective for most Ss. These objectives 
were then rated by four counselor-judges 
on a six-point scale ranging from “Ex- 
tremely Appropriate” to “Extremely Inap- 
propriate.” Available test data included at 
least the Strong Vocational Interest Blank 
and The University of Texas Admission 
Test (a general ability test with verbal 
and numerical subscores) or its equivalent 
(such as the School and College Ability 
Test or ACE Psychological Examination), 
plus any additional vocationally relevant 
tests assigned by individual counselors. On 
the basis of these test data, each judge 
rated all of the vocational objectives for 
approximately 170 clients, and each client’s 
objectives were rated by three of the four 
judges; care was taken that no judge should 
rate his own former client. The order in 
which the objectives appeared on the 
rating forms was varied systematically for 
each client and for each judge. In cases 
of rater disagreement, additional ratings 
were secured from a fifth judge, followed 
if necessary by a conference among judges. 
Interjudge reliabilities were computed 
between pairs of raters and ranged from 
.68 to .80 with the median at .71, suggesting 
a reliability of pooled ratings around .88. 


Results and Discussion 

Changes from Pre- to Postcounseling 

Of the 227 clients under study, 193 stated 
various precounseling vocational objectives, 
and the remaining 34 were initially un- 
decided. Of the 193 clients with stated 
precounseling objectives, 40 retained the 
same goals at the end of counseling, 
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90 changed or modified their objectives, 
and counseling was inconclusive or incom- 
plete for the remaining 63. Of the 90 who 
changed goals, 56 changed in a favorable 
direction (i.e., changed to something more 
appropriate), 15 changed unfavorably, and 
19 selected equally appropriate alternatives. 
Of the 34 initially undecided clients, 12 
chose postcounseling objectives which were 
rated appropriate, two selected inappro- 
priate objectives, 10 remained undecided 
at the end of counseling, and 10 failed to 
complete counseling. 

Both pre- and postcounseling vocational 
objectives were stated by 130 Ss. For these 
cases, two statistical tests for significance 
of changes in appropriateness-of-vocational- 
choice were available. First, it was possible 
to test the significance of the difference 
between pre- and postcounseling ratings 
of appropriateness by means of the statistic 
t. For precounseling objectives, the mean 
rating on the six-point scale of appropriate- 
ness-inappropriateness was 3.44; the post- 
counseling mean was 4.23. The resulting 
mean difference was .79; this improvement 
was significant at the .001 level (¢ = 5.99). 
McNemar’s (1955, pp. 228-31) change test 
provided a means for testing the signifi- 
cance of shifts from appropriate to inap- 
propriate objectives. The relevant con- 
tingency table is reproduced as Table 1. 
The resulting chi square was 21.33, which 
was also significant at the .001 level. 
Changes from Postcounseling to Follow-up 


Thus far results based on appropriateness 
of postcounseling vocational plans followed 
the usual pattern of apparent counseling 


success, if we assume that clients actually 
pursued vocational plans stated at the end 
of counseling. The one-year follow-up was 
designed to explore the validity of this 
assumption. 


The follow-up questionnaire was returned 
by 181 Ss, a return of 80 per cent. Of 
these, only 55 of 119 respondents by whom 
postcounseling plans had been specified, 
were actually enrolled one year later in 
the division of the university stated at 
the end of counseling. Analysis of the data 
for major subject revealed similar lack of 
persistence — only 48 of the 80 respondents 
who had stated postcounseling majors were 
actually pursuing these majors one year 
later. 


Of 103 respondents who stated both 
postcounseling and follow-up vocational 
objectives, only 38 retained the same ob- 
jectives from postcounseling to follow-up. 
However, although clients relatively seldom 
followed through with vocational plans 
stated at the end of counseling, neverthe- 
less there was a positive relationship 
between ratings of the appropriateness of 
postcounseling and follow-up objectives, 
as can be seen in Table 2. In addition, 
clients for whom counseling had been in- 
conclusive or incomplete showed a fairly 
marked tendency to gravitate toward 
vocational objectives which were inappro- 
priate, as may also be seen in Table 2. 
These data together yielded a chi square 
of 25.52, which for two degrees of freedom 
was significant well beyond the .001 level. 
Thus there appeared to be a high corre- 
lation between immediate postcounseling 


Table 1 


Changes in Appropriateness of Vocational Objective 
from Pre- to Postcounseling 








Postcounseling Objective 








Precounseling Objective Total 
Inappropriate Appropriate 
Appropriate 8 57 65 
Inappropriate 25 40 65 
Total 83 97 180 


y = 21.83 P < .001. 
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Table 2 


Changes in Appropriateness of Vocational Objective 
from Postcounseling to Follow-up 





Follow-up Objective 








Postcounseling Objective Total 
Appropriate Inappropriate 

Appropriate Objective 60 16 76 

Inappropriate Objective if 20 27 

Incomplete or Inconclusive 30 26 ‘ 56 

Total 97 62 159 


x = 25.52 P < .001. 





status and the appropriateness of vocational 
goals actually being pursued one year later. 
Predictive Validity of 

Pre- to Postcounseling Shift 

Over-all, a total of 68 clients — 49 per 
cent of the 139 Ss who completed counsel- 
ing and returned the follow-up question- 
naire — made shifts from precounseling to 
follow-up which were similar to the pre- 
to postcounseling shifts. Although relative- 
ly few clients persisted in vocational plans 
stated at termination of counseling, never- 
theless shifts in appropriateness from pre- 
counseling to follow-up were somewhat 
predictable from pre- to postcounseling 
shifts. 

The extent of this relationship — which 
in a sense represents the validity of the 
pre- to postcounseling shift as a measure 
of counseling outcome — is revealed in 
Table 3, which deals only with the 171 Ss 
for whom follow-up objectives were avail- 
able, and in which the following triple 
classification of outcome is employed: (a) 


“improved,” including all Ss who shifted 
to more appropriate objectives or aban- 
doned inappropriate ones; (b) “equiva- 
lent,” consisting of clients who did not 
change objectives, shifted to equally ap- 
propriate goals, or did not complete 
counseling; and (c) “regressed,” including 
those who abandoned appropriate ob- 
jectives or shifted to less appropriate goals. 
Analysis of Table 3 yielded a contingency 
coefficient of .47, which for four degrees 


‘of freedom was significant at the .001 level 


(chi square = 48.27). 

Table 4 presents data to test the hypothe- 
sis that changes set in motion by counseling 
(pre- to postcounseling shift) would con- 
tinue during the follow-up period (post- 
counseling to follow-up shift). It is obvious 
that trends begun in counseling were not 
continued in the follow-up period. In fact, 
the effect seems to have been somewhat 
in the opposite direction: of the 62 clients 
whose vocational plans improved from pre- 
to postcounseling, 28 apparently regressed 


Table 3 


Shifts in Appropriateness of Vocational Objective from 
Pre- to Postcounseling and from Precounseling to Follow-up 








Pre-Follow-up Shift 








Pre-Post 
Shift Regressed Equivalent Improved Total 
Improved 7 11 44 62 
Equivalent 25 88 23 86 
Regressed 15 4 4 23 
Total 47 53 71 171 


y = 48.27 P < .001. 
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Table 4 


Shifts in Appropriateness of Vocational Objective from 
Pre- to Postcounseling and from Postcounseling to Follow-up 








Post-Follow-up Shift 








Pre-Post 
Shift Regressed Equivalent Improved Total 
Improved 28 21 13 62 
Equivalent 17 26 11 54 
Regressed 5 7 ll 23 
Total 50 54 85 1389 





during the follow-up period, 15 of these 
to the precounseling level of appropriate- 
ness or lower. 

It is important to note that this trend 
might have been increased simply by ex- 
tending the follow-up period. The result 
would have been to obscure the correlation 
noted above between shifts from pre- to 
postcounseling and precounseling to fol- 
low-up, and possibly even to negate com- 
pletely apparent counseling gains. In order 
to be confident of the validity coefficient 
computed from Table 3, we must first be 
sure that this regressive trend had run its 
course. 


Changes from Precounseling to Follow-up 
Both precounseling and follow-up objec- 
tives were stated by 136 Ss. The mean ap- 
propriateness rating for precounseling ob- 
jectives was 3.26; the follow-up mean was 
3.76. The resulting mean difference was 
49, which was significant at the .001 level 
(t = 3.50). When shifts in appropriateness 
from precounseling to follow-up (Table 5) 
were subjected to McNemar’s change test, 
the resulting chi square was 12.52, which 
was also significant at the .001 level. Al- 


though both of these results were highly 
significant, it should be noted that in each 
case they were less significant than in the 
corresponding analysis of pre- to postcoun- 
seling shifts, and this was due to a general 
decrease in appropriateness from postcoun- 
seling to follow-up. Again the question 
arises as to what would happen if the fol- 
low-up period were extended over a longer 
time. 


Construct Validity of Pre- to Post- 
counseling Shift 

If it is assumed that a person would 
function more effectively in an “appro- 
priate” vocation, we might exnect the same 
person also to function more effectively in 
school work undertaken in preparation for 
that objective, especially to the extent that 
they are similar; moreover, the mere fact 
of having an appropriate objective might 
reasonably be expected to increase motiva- 
tion, thereby improving performance. 

It is worth noting that previous research 
has fairly consistently demonstrated the 
failure of counseling to improve grades. 
The present instance was no exception: for 
90 clients for whom both pre- and post- 


Table 5 


Changes in Appropriateness of Vocational Objective 
from Precounseling to Follow-up 








Follow-up Objective 








Precounseling Objective Total 
Inappropriate Appropriate 

Appropriate 11 50 61 

Inappropriate 40 35 75 

Total 51 85 136 


y = 12.52 P < 001. 
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counseling grades were available, the av- 
erage grade point average (GPA) for the 
semester preceding the start of counseling 
was 2.066 (A=4, B=3,... F=0), and 
for the semester following termination, 2.23; 
the resulting t was .19, which was clearly 
insignificant. However, it is possible that 
such an over-all test of significance might 
obscure differential effects of successful 
and unsuccessful counseling; i.e., perhaps 
grades improved for successful counseling 
cases and declined for unsuccessful. 


To test this hypothesis, the 90 clients 
with pre- and postcounseling grades were 
classified into seven groups according to 
pre- to postcounseling shift. Postcounseling 
GPA means for the various groups were 
compared, using analysis of covariance to 
control for precounseling GPA. The result- 
ing F was .76, which was insignificant. 


This hypothesis concerned construct 
validity. Negative results could mean simp- 
ly that the construct was invalid, i.e., that 
appropriateness-of-vocational-choice is un- 
related to grades. In the present instance, 
it was possible to correlate GPA directly 
with ratings of appropriateness of follow- 
up objectives. When these correlations were 
computed for the 67 Ss for whom both 
data were available, the resulting correla- 
tion was .06. Thus the appropriateness-of- 
vocational-choice criterion does not appear 
very meaningful in terms of academic per- 
formance. 


Perceived Counseling Influence 

One of the items on the follow-up ques- 
tionnaire was, “How did counseling in- 
fluence your choice of major and/or oc- 
cupation?” Out of 167 respondents, only 
29 credited their choices directly to counsel- 
ing. Sixty Ss stated that counseling “merely 
confirmed a decision already made,” 71 said 
counseling “had nothing to do with my pres- 
ent choice,” and the remaining seven 
claimed their plans had been made “in spite 
of counseling.” 

When these perceptions of the effects of 
counseling were compared with actual 
changes in vocational plans from pre- to 
postcounseling, the relationship was not 
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. 


statistically significant. Since clients’ follow- 
up judgments of counseling influence were 
apparently unrelated to changes during 
counseling, it seemed possible that they 
might be related to changes which oc- 
curred after counseling. Indeed, 20 of the 
29 clients who attributed their follow-up 
objectives directly to the influence of coun- 
seling had actually changed goals since the 
end of counseling; of the 39 clients who still 
retained their postcounseling objectives, 
only three felt their choices had been in- 
fluenced by counseling. The relationship 
between perceived counseling influence 
and shifts in appropriateness-of-vocational- 
choice from postcounseling to follow-up 
was significant at the .01 level. 


This result tends to support the argument 
of many counselors that vocational counsel- 
ing sets into motion decison-making proc- 
esses which continue after counseling has 
terminated, and that therefore the effects 
of vocational counseling may not be im- 
mediately apparent. However, it has already 
been shown that postcounseling changes, 
when they occur, are likely to be in the 
direction of a less appropriate choice, and 
as a matter of fact, this was true of 11 of 
the 20 Ss in the present study who changed 
goals from postcounseling to follow-up and 
credited counseling with the result. It might 
be speculated that exclients like to claim 
credit for changes which turn out favorably, 
and to blame counseling for those which 
do not. In any event, former clients’ gen- 
eralized impressions of counseling effective- 
ness were not positively correlated with 
shifts in appropriateness either during or 
after counseling. 


Summary and Conclusions 


This paper reports a critical examination 
of the appropriateness-of-vocational-choice 
criterion popularly employed as a measure 
of counseling outcome. Statements of voca- 
tional objectives were obtained from Uni- 
versity of Texas Testing and Counseling 
Center vocational clients at the beginning, 
at the end, and one year after termination 
of counseling. These objectives were rated 
for appropriateness by four counselor- 
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judges on the basis of the clients’ tested 
interests and abilities. 

Nearly half the sample of 227 clients 
changed their vocational plans from pre- 
to postcounseling, and about 60 per cent 
of these changed in the direction of greater 
appropriateness; the over-all increase in 
appropriateness was highly significant. The 
incidence of change in both educational 
and vocational plans was_ significantly 
greater among clients whose precounseling 
objectives had been rated inappropriate. 

When clients were followed up one year 
later, however, it was found that only 29 
per cent were still pursuing their postcoun- 
seling vocational objectives. On the other 
hand, postcounseling and follow-up ratings 
of appropriateness were highly correlated. 
Similarly, the direction of the shift in ap- 
propriateness from pre- to postcounseling 
was highly correlated with the correspond- 
ing shift from precounseling to follow-up. 
In other words, changes in appropriateness- 
of-vocational-choice measurable immediate- 
ly after counseling seemed to be valid 
predictors of longer-range trends. It was 
also noted that the pre- to postcounseling 
trend was rarely continued in the follow-up 
period and in many cases even reversed, 
and that results based on immediate post- 
counseling plans seemed to “wash out” 
slightly when follow-up objectives were 
considered. It was suggested that this ef- 
fect, if extended, would likely reduce the 
apparent validity of the appropriateness- 
of-vocational-choice criterion and perhaps 
even negate what seemed to be evidence 
for the effectiveness of vocational counsel- 
ing. It was also found that the clients’ own 
impressions of the effectiveness of voca- 
tional counseling were related more to 
changes which occurred after counseling 
than during it. 

Finally, it was observed that changes in. 
appropriateness of vocational choice were 
not reflected by changes in academic per- 
formance, and grades were not correlated 
with appropriateness ratings. To the extent 
that academic preparation is related to sub- 
sequent vocational adjustment, there ap- 


peared to be some question regarding the 
meaningfulness of the concept of appro- 
priateness-of-vocational-choice as a meas- 
ure of counseling outcome. 

In general, although change in vocational 
plans as a result of counseling appeared 
to be reflected in subsequent vocational 
development up to one year later, neverthe- 
less such a criterion does not appear to be 
a valid measure of enduring, meaningful 
effects of vocational counseling, and the 
assumption that such effects occur at all 
remains undemonstrated. 


Received November 18, 1961. 
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Comment 


Counseling and psychotherapy outcome 
studies have seemed conspicuous by their 
relative absence in recent years. A most 
notable illustration of this occurred in Re- 
search in Psychotherapy where the investi- 
gators’ efforts were entirely devoted to proc- 
ess variables. Hopefully Gonyea’s paper 
may lead to more outcome study if only as 
a result of questioning whether realism of 
vocational choice or plan is an appropriate 
goal of vocational counseling. On the sur- 
face this may appear to be a ridiculous 
question. What could be more appropriate? 
And yet the question is deceptively com- 
plex. Gonyea’s investigation delineates the 
complexities of change in client’s status 
from precounseling to postcounseling and 
to follow-up status one year later. His data 
indicates some unexpected shifts within a 
total shift (Table 5) in the direction of in- 
creasing appropriateness and decreasing in- 
appropriateness. 

Appropriateness of vocational choice, he 
finds, does not appear very meaningful in 
terms of academic performance. The more 
vocationally oriented one is in his interpre- 
tation of the goals of higher education the 
more likely it is that this will be a surpris- 
ing (or discouraging) finding. Of course 
grade point averages may be relatively in- 
consequential above a certain point—and 
hence bear little relationship to judged ap- 
propriateness of choice, or to entry and sta- 
bility in a vocation. It would be interesting 
to follow up these clients now, ascertain 
graduation-nongraduation rates plus their 
present vocational placement status. I 
would expect that counselor-judges would 
find graduation-nongraduation rates more 
significant data than grade point averages. 
I would also expect their judgments of ap- 
propriateness to be made more confidently 
when in terms of the man-on-the-job rather 
than the-student-in-an-educational-major. 

Gonyea’s paper stimulates me to wonder 
just how “vocational” is our typical “voca- 
tional counseling” in a college counseling 
center. Counseling clients are usually a 
number of years away from their entry 


occupations in the world of work. Further- 
more, with a few exception, students enter 
a wide array of occupations which may 
have little relevance to their academic 
major field of study. Counselors can do 
little about these matters, but perhaps they 
argue for giving more attention to ultimate 
(job placement and stability) than to im- 
mediate criteria. 

Gonyea’s investigation should be a 
valued stimulus for reappraisal of realism 
type criterion measures. On the one hand 
some might defend the view that taking 
all ambiguities into account, such measures 
are relatively fruitless vehicles for assessing 
counseling outcomes. On the other hand, 
some might take the view that to scuttle 
such criterion measures would be most 
premature. Some time ago Berdie suggested 
that judgmental criteria will have to do 
until better criteria are identified. Since 
then there has not been much in the way 
of criterion measure developments in voca- 
tional counseling. 

It is not time to investigate the nature 
of the relationship between vocational 
choices of the kind Gonyea describes and 
placement (and change in placement) in 
the world of work? Clients do graduate, 
drop-out, or withdraw from educational 
institutions. Presumably they then venture 
forth vocationally. What is their status then 
and how predictive are their earlier choices 
and counselors’ judgments of them? This 
point of view should provide both more 
ultimate criteria of vocational counseling, 
and should clarify the validity of our own 
expertise regarding the attributes of realism 
in vocational choice and subsequent action. 
Appropriateness of vocational choice is a 
relevant criterion, if such choices serve as 
surrogates of subsequent vocational actions. 
If they do not so serve, we should know it. 
Counselor judgments of appropriateness of 
vocational choice should be valid criterion 
measures. If they are not, then why aren’t 


they? 
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Occupations of Counseling Psychologists 
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Within recent years, a number of articles 
and reviews have called attention to the 
development of counseling psychology as 
a specialty (ABEPP, 1953; APA, 1952; Ber- 
die, 1959; Bordin, 1951; Committee on 
Definition, 1956; Hahn, 1955; Hobbs & 
Seeman, 1955; Shaw, 1957; Shoben, 1956; 
Tyler, 1958). The intent of these articles 
has been to point up the differences of 
counseling from various other specialties 
of psychology, and to outline the unique 
contributions counseling makes as a pro- 
fessional group. 

The attempt to distinguish counseling 
from other specialties has led to some dis- 
agreement of definition and limitations. It 
would seem that this disagreement—if cru- 
cial—should be felt by counseling gradu- 
ates, depending upon their orientation. 
Such a condition, perhaps, would be re- 
flected in job positions occupied by these 
graduates and settings in which they oper- 
ate. One could then expect that any trends 
now in progress leading to unification or 
diversification of the specialty might be 
indicated in this way. This study represents 
an attempt to assess such a proposition. 


Design of the Study 


The population for this study was de- 
fined as graduates of doctoral programs 
in counseling psychology approved by the 
American Psychological Association. Direc- 
tors of these programs were asked to sub- 
mit a list of graduates of their programs 
since APA approval. Information concern- 
ing each graduate’s employment status was 
then obtained from the lists submitted or 
from the APA Directory, whichever was 
more current. When more than one posi- 
~ 1The authors wish to express appreciation to 
the directors of counseling programs from whom 
lists of graduates were received. This study was 
conducted as a project in professional problems 
in psychology under Robert S. Daniel. 


tion was listed, that given as primary was 
used. From this data, frequency of job posi- 
tions and their settings were tabulated. The 
job position indicates the occupational 
group with which a graduate is identified. 
Setting refers to the place of employment. 


Subjects 

As of June, 1960, 25 colleges and uni- 
versities had counseling programs ap- 
proved by APA. Five of these had pro- 
grams in both the departments of psy- 
chology and education, making a total of 
30 programs in all. Of the 25 institutions, 
9 were in the east, 9 in the Mid-west, 4 in 
the South, and 3 in the West. Reports were 
received from 27 of the 30 programs. These 
reports listed a total of 337 graduates since 
their approval by APA. Of these 337, no 
information was available regarding job 
position on 10 of them; no information 
was available regarding job setting on two; 
and no information as to either position or 
setting on 48. 


Procedure 


When the data were obtained, all various 
job positions and settings of the graduates 
were listed. For purposes of tabulation, if 
two or more of the positions appeared to 
be essentially the same, and little or no 
meaning was lost by grouping, they were 
grouped according to some common ele- 
ment. This same procedure was followed 
with the job settings. This resulted in 8 
job positions and 14 job settings. It is to 
be noted that job positions listed here are © 
not considered to be descriptive of job 
performance. These data indicate only the 
position which the graduates hold accord- 
ing to the APA Directory or in correspond- 
ence with the graduate program director at 
the institution from which they obtained 
their doctoral degree. 
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Findings 
After the final lists of positions and set- 
tings were completed, a table was con- 
structed so that each graduate could be 
represented on both types of information. 
These data are presented in Table 1. 


Table 1 


Job Positions and Settings of Graduates 
in Counseling Psychology 











(n=887) 
Position and Setting Number of Percentage of 
Graduates Graduates 
Counseling Psychologist 
College/University 
(Counselors) 44 15b 
Veterans Administration 83 ll 
Industry 2 e 
Hospital (General) 2 c 
Information as to Setting 
Not Available 1 c 
Total 82 28 
Faculty (College/University, 
Teaching) 72 24 
Director 
Student Personnel 
Services 16 5 
College/ Universit 
Counseling and/or 
Testing Service 14 5 
State/National Agency 
and Armed Services 7 2 
Public Education 7 2 
Research Program 4 1 
Personnel in Industry 8 1 
Private Agency 2 c 
Hospital Psychology 
Services 2 c 
Child Service 1 c 
Training in Industry 1 c 
Rehabilitation Services 
in Hospital c 
Total 58 20 
Psychologist (Specialty Not Designated) 
Industry : 2 
Public Education 2 
Hospital (Other than VA) ; 2 
Clinic 4 | 
Veterans Administration 2 c 
Child Services 2 c 
Total 24 8 
Research Psychologist (Staff Position) 
State/National Agency 
and Armed Services 7 2 
College/ University 5 2 
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Research Program 
Industry 

Child Services 
Veterans Administration 


a 
°]a 8 





Total 

Clinical Psychologist 
Veterans Administration 
College/ University 
State/National Agency 
Hospital (Psychiatric) 
Hospital (General) 
Child Services 
Clinic 
Information as to Setting 
Not Available 1 c 


Total 18 6 
Consultant (Industry) 8 8 
Information as to Position 

Not Available 
Private Practice 4 J 
Veterans Administration 3 1 
College/University 
Armed Services 1 


Total 10 8 
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Information as to Position 
and Setting Not 


Available 43 (18)4 

aBased on the 294 graduates for whom informa- 
tion was available. 

bAll percentages over 1 per cent rounded to near- 
est figure. 

cLess than 1 per cent. 

daThis 13 per cent is based upon the total of 337 
graduates—and is that penton of the total not in- 
cluded in computing the other percentages. 





Percentage of graduates in the settings 
occuring most frequently was then cal- 
culated. These results are given in Table 2 











Table 2 
Percentage of Graduates in Settings 
Setting Number of Percentage of 
Graduates Graduates 
College/ University 156 58 
Veterans Administration 44 15 
Industry 23 8 
State/National Agencies 
and Armed Services 17 6 
Hospitals (Other Than VA) 14 5 
Public Education 12 4 
Total 166 91 





Note.—These are the six most prominent settings. 
aBased on the 292 graduates for whom information 
as to job setting was available. 
anne. perce itages over 1 rounded to nearest whole 
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Discussion 


The data from this study suggest that a 
number of trends are currently in existence 
within the specialty of counseling psy- 
chology. In answer to the initial proposi- 
tion stated in this paper, it was anticipated 
on the basis of readings selected for re- 
view that the graduates would be greatly 
scattered and diversified over many job 
positions and settings. On the contrary, 
although there are 8 job positions and 14 
job settings described, there is a tremen- 
dous amount of grouping. In this sample, 
over three-quarters of the graduates are 
in only four different job positions. Almost 
half of them are in one job setting, while 
almost another quarter of them are in two 
additional settings. These results would, 
therefore, indicate a trend toward unifica- 
tion in counseling psychology. 


A most pronounced concentration of 
these graduates appears in the faculties 
of colleges and universities where 53.5 per 
cent of the total are found to be employed. 
Of this 53.5 per cent, which represents 156 
graduates, 46. 2 per cent are members of 
the teaching faculty, 28.2 per cent are em- 
ployed as counselors, and 8.9 per cent are 
directors of counseling and/or testing serv- 
ices; the remainder are in positions of re- 
search, clinical psychologist, or psycholo- 
gist. There are also a number of graduates 
in other public educational settings. This 
concentration would seem to be indicative 
of a definite trend in counseling psychol- 
ogy. 

An interesting outcome of this study is 
the small number of graduates working in 
any setting with the specific position of 
research. Although it cannot be assumed 
that other job positions do not generate 
research, it would seem that those people 
graduating in the applied area of counsel- 
ing psychology prefer to remain identified 
as the “applied” professional. If not this, 
then it is possible that there are few speci- 
fic research positions existing in counseling 
psychology. 

A concern that appears to be harbored 
by a number of counseling psychologists 
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is that graduates of counseling programs 
desire to identify more in the clinical area 
of psychology. The results of this study in- 
dicate that very few of the graduates iden- 
tify themselves in this way. Since this 
sample was drawn from those schools hav- 
ing a VA affiliation for practicum training, 
it would be expected that even fewer 
graduates from other programs would 
identify themselves with the clinical area. 
The results also indicate that few counsel- 
ing graduates are working with the “ab- 
normal” population (e.g., few in clinical, 
few in psychiatric hospitals, few in 
clinics). This further supports the conten- 
tion of a trend toward a consolidation of 
purpose in counseling psychology. 

Since counseling psychology is an ap- 
plied area, one might expect that a reason- 
able number of graduates would be in 
private practice. Concern with ethical 
standards and professional relations has 
been generated partly. with such anticipa- 
tion. The results of this study, however, 
indicate a surprisingly low number of 
graduates actually engaged in full-time 
private practice. 

As a sidelight to this study, it was of 
interest to note that of the 337 graduates 
in this sample, 19.9 per cent do not hold 
APA membership. The 80.1 per cent who 
are members represent 270 graduates. Of 
these latter, 60.4 per cent hold no division 
membership; 3.7 per cent are members of 
Division 12 (Clinical); 21.8 per cent are 
members of Division 17 (Counseling); 2.6 
per cent belong to both Division 12 and 
17; and 11.5 per cent do not belong to 
Division 12 or 17, but to other divisions. 
Of those holding memberships in Division 
12 and/or 17, 8.5 per cent also belong to 
other divisions. 

In summary, these results indicate that 
the specialty of counseling psychology is 
tending toward a consolidation, with a 
concentration on applying skills in helping 
the school and college population. Whether 
this same pronounced trend would be 
observed in the graduates of all counseling 
programs is a further question. 

Received April 17, 1961. 
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During recent years, the increased de- 
mand for psychological services has been 
accompanied by a rapid growth in the num- 
ber of clinical psychologists. Emerging from 
its infancy during the 1940's, clinical psy- 
chology has been relatively successful in 
establishing a clearly delineated area of 
specialization. More recently, the field of 
counseling psychology has also assumed its 
place as a professional specialty. At the time 
of its inception, a committee whose specific 
purpose was to define the field of counsel- 
ing psychology (1956) proposed certain 
tenets which it considered basic to that 
area of specialization and which differen- 
tiated it from clinical psychology. Examina- 
tion of the literature since then suggests 
that counseling psychologists have general- 
ly been more concerned with crystallizing 
a point of view regarding similarities and 
differences between clinical and counseling 
psychology than have clinicians. 

The APA committee which sought to de- 
fine the province of counseling psychology 
was sufficiently aware of the overlap be- 
tween the two fields to suggest that “the 
problem of convergence of functions may 
be resolved by simplification of the exist- 
ing structure” (1956, p. 285). The state- 
ment of the committee indicated that “a 
broad group of functions may come to be 
performed under a new and single banner,” 
although the committee was concerned that 


1This study was conducted while the authors 
were at Brockton VA Hospital. 


such a fusion should not take place in such 
a way that “important, presently performed 
functions are slighted or ignored.” 

Various members of the committee have 
also recognized in other publications that 
overlapping between clinical and counsel- 
ing is indeed extensive. For example, Bor- 
din (1955, p. 16) has mentioned that “when 
the suggested Ph.D. training programs for 
counseling and clinical psychology are com- 
pared, one finds that the differences be- 
tween them are almost negligible when 
compared with the variation among univer- 
sities in their training programs for each 
area.” Super (1955, p. 5), after suggesting 
that clinical psychology has been typically 
concerned with diagnosing the nature and 
extent of psychopathology, whereas coun- 
seling psychology concerns itself with nor- 
malities, even of abnormal persons, adds 
that “perhaps in due course the two fields 
will merge in a more broadly trained and 
oriented field.” Hadley’s (1958) recent text 
on clinical and counseling psychology also 
gives evidence of this general orientation. 
He suggests that the distinction between 
clinicians and counselors has become less 
apparent, but that counseling psychologists 
are more often employed in schools, in- 
dustry, and various community activities, 
whereas clinical psychologists are more 
often found in clinics and hospitals. 

Although the blurring of distinctions be- 
tween the two specialties has thus been 
widely recognized, the very fact that two 
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specialties exist indicates that areas of dif- 
ferentiation are present. Hahn (1955) has 
suggested various hypotheses regarding pos- 
sible differences between the specialties, 
but there is almost no empirical work which 
would clarify the differences. Kiland (1958) 
reports a study done in 1956 in which 
he administered Thorndike’s Activities Pref- 
erence Blank to 19 clinical psychologists and 
trainees and to 24 counseling psychologists 
and trainees, in an effort to investigate in- 
terests of the two groups. This author found 
that counseling psychologists scored signi- 
ficantly higher on preference for working 
in industry, while there was no significant 
difference between counselors and clini- 
cians in four areas of activity (helping in- 
dividuals, scholarship, experimental, or ad- 
ministrative). In one other recent study, 
Granger (1959) found that psychologists 
generally gave higher prestige rankings to 
the title of clinical psychologist than to 
that of counseling psychologist. Although 
ABEPP diplomates in counseling ranked 
the title of counseling psychologist fourth 
in a tied position with that of clinical 
psychologist, all other subgroups, except 
associates in the Division of School Psy- 
chology, ranked the title considerably lower, 
iie., from a rank of seventh to a rank of 
tenth. 
The Problem 


The purpose of the present study was 
to provide further clarification of the simi- 
larities and differences between clinical and 
counseling psychologists, as perceived by 
clinical and counseling psychologists them- 
selves. We wished to determine (a) those 
skills, activities and functions of the special- 
ties concerning which members of both 
fields shared similar perceptions and (b) 
those respects in which clinicians and coun- 
selors did not agree in their perceptions. 
In addition, we were interested in the ex- 
tent to which members of both groups 
possessed similar stereotypes regarding the 
personal characteristics, professional atti- 
tudes, and values of clinical and counseling 
psychologists. Our present study was con- 
fined to clinicians’ and counselors’ percep- 
tions of field practitioners in both special- 
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ties, rather than pertaining to all clinical 
and counseling psychologists. 


Method 


Subjects for the study consisted of uni- 
versity faculty members, VA staff psycholo- 
gists, and VA trainees. Questionnaires were 
initially sent to 520 subjects, of whom 420 
responded. Subjects who returned question- 
naires consisted of 80 university clinical 
psychology faculty members, 30 university 
counseling psychology faculty members, 99 
VA staff clinical psychologists, 37 VA staff 
counseling psychologists, 22 VA mixed 
staff,? 111 clinical psychology trainees and 
41 counseling psychology trainees. Respond- 
ents were selected from universities and VA 
stations having both clinical and counseling 
programs, in order that each respondent 
would have had (a) sufficient opportunity 
for contact with members of the other 
specialty, and (b) knowledge of the other 
specialty’s typical functions. The sample of 
university faculty members was obtained 
by selecting members of each faculty at all 
universities which have APA approved pro- 
grams in both clinical and counseling psy- 
chology.® Since the number of clinical and 
counseling faculty differed considerably, 
a stratified sample of the former and the 
universe of the latter were sent question- 
naires. Field staff selected for study were 
taken from all of the major geographical 
areas of the country. The clinical sample 
was stratified to include both the appro- 
priate number of respondents from each 
geographical area in the United States and 
the appropriate ratio of chiefs to staff 
members. 


The Instrument Used 


The instrument used for studying clini- 
cians and counselors’ perceptions consisted 


2Mixed staff refers to VA field staff members 
who rated themselves as being both clinical and 
counseling psychologists. 


8This included every APA-approved doctoral 
program in counseling psychology in the United 
States, except the University of Maryland, which 
had a counseling program but no clinical program 
when the study was conducted. 
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of a 68-item questionnaire devised by the 
authors. Respondents were asked to indi- 
cate for each item, by using a five-point 
scale, whether they considered the item 
much more characteristic of counselors than 
clinicians, slightly more characteristic of 
counselors than cJinicians, equally charac- 
teristic of clinicians and counselors, slightly 
more characteristic of clinicians than coun- 
selors, or much more characteristic of clin- 
icians than counselors. 


Five major areas of interest were encom- 
passed by the items: (1) A large number 
of items concerning clinicians’ and coun- 
selors’ relationships with patients. Items re- 
ferred to the type of patient with whom 
each group typically works, attitudes to- 
ward various theoretical frameworks used 
in conceptualizing patient-therapist inter- 
actions, major emphasis in interview con- 
tacts with patients, basic beliefs regarding 
the alteration of personality structure, and 
the use of various diagnostic instruments. 
(2) Items referring to various professional 
activities, such as performing psychother- 
apy, research, administration, and person- 
nel selection. (3) Items focused upon at- 
titudes toward psychiatrists, social workers, 


one’s own specialty, and the other applied 


psychological specialties. (4) Seventeen 
personality characteristics, for each of 
which subjects were to compare clinicians 
and counselors. (5) Comparison of the 
two groups in terms of various professional 
skills and kinds of knowledge. 

Items in the questionnaire were pretested 
for comprehensibility and lack of ambig- 
uity. Questionnaires were mailed to re- 
spondents in May and June 1959. Two fol- 
low-up letters were prepared and sent 
where necessary. Seventy-six per cent of 
the initial sample returned the completed 
questionnaire without requiring follow-up 
letters. An additional five per cent re- 
sponded to one of the follow-up letters, for 
a final return of eighty-one per cent. 

The chi-square technique was used in the 
analysis of the data. One set of analyses 
consisted of testing whether the responses 
to each item differed significantly from a 
chance distribution. Another set of analyses 


was conducted to determine whether there 
was an over-all significant difference among 
various subgroups’ responses to each item. 
If differences for a given item were signifi- 
cant, further tests were carried out to deter- 
mine which groups differed from each 
other. 
Results and Discussion 


Results of the study are presented in 
Figures 1 and 2, and Tables 1 and 2. All 
findings mentioned have probability values 
of at least .05. In actuality, most of the 
findings have probability values of .01 or 
beyond. 

It will be recalled that for clinical and 
counseling groups, university faculty, VA 
field staff and VA trainees were included 
in both samples. In Figures 1 and 2 and 
Table 1, findings will be presented for 
each of the groups taken as a unit. For 
Table 2, items are presented for which 
breakdowns are required according to 
whether the respondent is faculty, staff, or 
trainee. 

In Figure 1, items are reported for which 
there is one predominant perception which 
is shared by clinicians and counselors. This 
refers to items for which (a) the over-all 
distribution differs © significantly from 
chance and (b) on which both clinicians 
and counselors gave the same rating, ie., 
the two groups differ from chance in the 
same way. In Figure 2, findings also differ 
significantly from chance, but both clin- 
icians as a group and counselors as a group 
have two perceptions, which are the same 
for both groups. In other words, each of 
the specialties has two predominant per- 
ceptions, which are the same for both 
specialties. 

When the findings presented in Figures 
1 and 2 are considered jointly, they suggest 
that there is considerable consensus among 
clinicians and counselors regarding the defi- 
nition and performance of clinician and 
counselor roles. The fact that there is also 
consensus regarding behavior which may 
be characteristic of both specialties lends 
empirical support to the notion that the 
two specialties are in certain ways over- 
lapping and in other ways quite separate. 
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More Characteristic of 


Equally Characteristic of 
Counselors and Clinicians 


More Characteristic of 
Clinicians Than Counselors 


Counselors Than Clinicians 





1. Working with normals 1. Working with people who 1. Working with people who 


have problems of marital 
adjustment 


have severe emotional dis- 
turbances 


2. Working with people who 2. Use of intelligence tests 2. Use of projective personal- 
have educational and voca- ity tests 
tional problems ‘i 
8. Use of paper and pencil 8. Belief that people can alter 8. Having a Freudian orien- 
personality tests their interpersonal relation- tation 
ships through psychothera- 
peutic contacts 
4. Use of interest and apti- 4. Having a learning theory 4. Having a neo-Freudian 
tude tests orientation orientation 
5. Belief in trying to find 5. Having an eclectic theoreti- 5. Focusing on the patient’s 
an environment compatible cal orientation past behavior 
with the individual’s per- 
sonality structure rather 
than trying to alter his 
personality structure 
6. Having a Rogerian orienta- 6. Reflecting the feeling im- 6. Discovering and working 
* tion plicit in material discussed through the patient’s major 
by the patient conflict areas 
7. Performing personnel selec- 7. Performing administrative 7. Interpreting the patient’s 
tion and placement duties duties motives to him 
8, Giving educational and oc- 8. Being satisfied with the 8. Feeling envious of psychia- 
cupational information amount of financial re- trists 
muneration from their role 
9. Being practical 9. Being idealistic 9. Feeling competitive toward 
psychiatrists 
10. Being skilled in the use of 10. Being spontaneous 10. Using psychiatrists as a 
objective instruments role model 
11. Knowledgeable regarding 11. Having skill in interview- 11. Having skill in the use of 


educational and _ occupa- ing people projective instruments 
tional information ; 
12. Performing applied _ re- 
search 





Fig. 1. Items on Which There Is One Predominant Perception Which Clinical and Counseling Psycholo- 


gists Share* 
*All items reported herein are significant at .05 level or better. 





More Characteristic of Counselors 
or Equally Characteristic of Both 


Equally Characteristic of Both or 
More Characteristic of Clinicians: 





1. Belief that with minimal assistance most people 1. Being aesthetically oriented 
can solve their own conflicts 
2. Using exhortation to bring about change in 2. Being unconventional 


the patient’s behavior 


Being verbally facile 
Being neurotic 


8. Supporting the patient’s assets 8. 
4, Belonging to the psychological specialty which 4. 
has assumed functions originally associated 

with other specialty 

5. Having competitive feelings toward the other 
specialty 

6. Being optimistic 

7. Being reality oriented 

Fig. 2. Items on Which There Are Two Predominant Perceptions Which Clinical and Counseling Psy- 


chologists Share* 
*All items reported differ significantly from chance at .05 level or better. 














Clinical and Counseling Psychologists’ Perceptions 


In Table 1, two groups of items are of 
particular interest. For one of these groups 
of items, counselors perceive them as equal- 
ly characteristic of both specialties, whereas 
clinicians consider these same items to be 
either more characteristic of themselves or 
equally characteristic of both. The items 
involved include being empathic, being 
sensitive, being intellectually curious, hav- 
ing over-all skill as a psychologist and hav- 
ing skill in research methodology. Whether 
these differences in perception are indica- 
tive of greater self-confidence and chauvin- 
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ism by clinicians plus accurate reality as- 
sessment by counselors, or a self-depreca- 
tory attitude by counselors and accurate 
reality assessment by clinicians, is a matter 
for speculation. A second group of items 
in the Table include those which counselors 
consider either equally characteristic or 
more characteristic of themselves, whereas 
clinicians predominantly consider them to 
be equally characteristic. These items in- 
clude being enterprising and being reality 
oriented. Both these attributes are perhaps 
especially valued by counselors. 


Table 1 


Items on Which Clinical and Counseling Psychologists 


Differ in Their Perceptions* 











Item 


Counselors’ Perceptions 


Clinicians’ Perceptions 





More Char. 
of Coun. 


Equally 
Char. 


More Char. 
of Clin. 


Equally 
Char. 


More Char. More Char. 
of Clin. of Coun. 





1. Working with the mild- x 
ly emotionally disturbed 

2. Working with people x 
who have problems of 
general maladjustment 

8. Conducting interviews x 
which focus on the pa- 
tient’s current behavior 

4, Performing basic psy- x 
chological research 

5. Adopting a dependent x 
relationship in dealing 
with psychiatrists 

6. Being defensive 

7. Being enterprising x 

8. Being empathic 

9. Being sensitive 

0. Being reality oriented x 

1. Being intellectually cur- 
ious 

12. Being pedantic 

13. Being shallow 

14. Skill in performing psy- x 
chotherapy ; 

15. Having over-all skill as x 
a psychologist 

16. Having skill in research x 
methodology 


17. Having knowledge of x x 
current developments in 
the field of psychology 


a ee ee 


~~ OM 


x 


a 





*Distributions for the two groups differ at .05 level or better. 
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Table 2 
Items on Which Perceptions Differ Within and/or Between Specialists* 











Counseling Psychologists’ 


Clinical Psychologists’ “ 








Perceptions Perceptions 
Faculty Staff Trainees Faculty Staff Trainees 
1. Performing psychotherapy Cl>Co# Cl=Co Cl=Co Cl>Co Cl>Co Cl>Co 
2. Being satisfied with the Cl=Co Cl=Co Cl=Co Cl>Co Cl>Co Cl=Co 
amount of status and prestige 
gained from the professional 
role 
8. Feeling competitive toward | Cl=Co Cl=Co Co>Cl Cl=Co Cl=Co Co>Cl 
social workers 
4, Being outgoing Cl=Co Cl=Co Cl=Co Cl>Co Cl=Co Cl=Co 
or or or or or 
Co>Cl Co>Cl Co>Cl Co>Cl Co>Cl 
5. Having knowledge of the Cl>Co Cl=Co Cl>Co Cl>Co Cl>Co Cl>Co 


theories of personality 





*All differences within and between groups are significant at .05 level or better. 
aCl>Co means that the particular subgroup rates the item as more characteristic of clinicians than of coun- 


selors. 


Cl=Co means that the particular subgroup rates the item as equally characteristic of clinicians and coun- 


selors. 


Co>Cl means that the particular subgroup rates the item as more characteristic of counselors than of clini- 


cians, 


Table 2 includes items on which sub- 
groups of ‘a given specialty may disagree 
with each other but agree with subgroups 
of the other specialty, or on which members 
of one specialty may agree with each other, 
but subgroups within the other specialty 
may have differing perceptions. 

It is of interest to consider our findings 
in connection with the hypotheses sug- 
gested by Hahn (1955) regarding differ- 
ences in the orientation of clinicians and 
counseling psychologists. Our data are con- 
sistent with his hypotheses that counseling 
psychologists are less concerned with re- 
organizing basic personality structures than 
are clinicians, that counselors have greater 
concern with a positive approach to trait 
strengths and less concern with medically 
diagnosed personality deviations requiring 
psychotherapy than do clinicians, and that 
counselors resemble industrial psycholo- 
gists in their general orientation more than 
they do psychotherapists. One could inter- 
pret the data on performance of administra- 
tive duties as failing to support Hahn’s no- 
tion that counselors have greater manager- 


ial and administrative interests than do 
clinicians. 

From the viewpoint of counseling psy- 
chologists, certain results of the present 
study may be disturbing. Regardless of the 
accuracy of their perceptions, the tendency 
for a sizable group of clinicians to perceive 
themselves as having more over-all skill as 
psychologists, more skill in performing psy- 
chotherapy, more skill in research methodol- 
ogy, to be more knowledgeable regarding 
theories of personality, to be more charac- 
teristically curious, empathic, and sensitive 
as a professional group than are counselors 
must be given due consideration. Although 
our other findings indicate that differences 
in role definition between the two special- 
ties may be articulated, the findings just 
cited raise a further and perhaps more im- 
portant question, as to whether counselors 
need to consider the validity and desirabil- 
ity of the perceptions of them held by. clin- 
icians. 

In this connection, it is believed that 
Granger’s results, discussed earlier in the 
paper, should be considered along with 
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those of the present study. If one puts the 
findings of both studies together, it may 
be suggested that clinicians’ perceptions 
of counselors are shared by other psycho- 
logical specialties. Although counselors see 
themselves and clinicians as having equal 
prestige as well as being peers in certain 
important areas of skill and competency, 
other professional groups do not share in 
this judgment. If such an inference based 
upon the two sets of data has any validity, 
it is felt that counselors should begin to 
ask themselves how such perceptions have 
arisen, and whether they wish to fully per- 
petuate the view of them held by their 
professional colleagues without alteration. 


Summary 


The purpose of the present study was to 
investigate clinical and counseling psycholo- 
gists’ perceptions of field practitioners in 
clinical and counseling psychology. We 
sought to determine those areas in which 
specialty members agreed and disagreed in 
their perceptions of each specialty. A 68- 
item questionnaire constructed by the au- 
thors was administered to 420 subjects, 
which included university faculty members, 
VA staff psychologists, and VA trainees in 
both specialties. 

Results of the study indicate that there 
are some role attitudes and behaviors con- 
sensually perceived as relatively unique to 
each specialty, as well as other attitudes 
and behavior patterns that are regarded as 
equally characteristic of both specialties. 
Findings of the study are consistent with 
several of Hahn’s hypotheses regarding dif- 
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ferences between clinicians and counselors, 
namely, that counselors (a) are less con- 
cerned than clinicians with reorganizing 
basic personality structure, (b) tend to 
focus more upon personality assets, and 
(c) are more similar to industrial psychol- 
ogists than to psychotherapists. Results 
with regard to perceptions of over-all com- 
petence as a psychologist indicate a tend- 
ency for counselors to evaluate themselves 
less favorably than clinicians evaluate them- 
selves. Clarification of the way in which 
the counselor’s job is perceived by himself 
and his fellow clinicians is viewed as rais- 
ing a further question as to whether this is 
a totally satisfactory set of perceptions 
which should be perpetuated without modi- 
fication. 


Received November 18, 1961. 
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Student Personnel Workers on the Spot 


Paul T. Correll’ 
The Ohio State University 


Student personnel workers, it seems to 
me, have in common a basic recurrent, 
central conflict from which others tend to 
radiate. Faced with larger numbers of stu- 
dents and greater complexities of organi- 
zation, student personnel workers have 
found it more and more necessary to tight- 
en controls upon the behavior of students. 
There is a greater need to delimit and regu- 
late behavior — one person’s actions can 
affect greater numbers of other people, and 
affect them more quickly and more pro- 
foundly. There is a need to enforce student 
loyalty and obedience, and there is a striv- 
ing for greater organizational efficiency 
and better communication, the ultimate 
aim being predictability and unity of indi- 
vidual member action. ; 

On the other hand, student personnel 
workers profess a deep commitment to a 
so-called “personnel point of view,” with 
the avowed purposes of benevolence, dem- 
ocratic egalitarianism and the recognition 
of differing individual needs and interests. 
The controlling person in the student per- 
sonnel world must be — or at least appear 
to be benevolent and kind. Personnel peo- 
ple, as agents delegated by the institution 
to perform institutional functions, must 
administer and contro! in order to do their 
jobs efficiently — indeed, in order to sur- 
vive in the institution. They must, on the 
other hand, be benign and ever attuned to 
the needs of individual students in order 
to meet the demands of their own self- 
images, as well as those of the students, the 
institution, and society alike. How to re- 
solve this dilemma? 


Control Activities Hidden 
One obvious solution evidently employed 
by at least some student personnel offices, 
1Condensed from a paper presented at the 
Eleventh Invitational Conference of College and 


University Counseling Center Administrators, East 
Lansing, Michigan, October 22, 1961. 


is that a major portion of the work must 
be conducted with the lowest visibility 
possible. Control activity must be obscured 
— even from the agent doing the control- 
ling. With the less directly humane motives 
so well protected, the egalitarian values can 
emerge as the after-the-fact reasons given 
as fully palatable apologetica for all kinds 
of controlling acts. Thus, “student welfare” 
is revealed as a deeply held value toward 
which student personnel workers strive, 
but there are other, sometimes conflicting 
allegiances too — the welfare of the uni- 
versity, the expectations of parents, and 
the interests of the supporting society. The 
problem of which interest to serve first, 
when, is a source of real anxiety to person- 
nel workers. 

Asking personnel workers what their jobs 
are would probably result in descriptions 
that might be categorized as either service 
to or control over students, or combinations 
of both. However, in my experience, it is 
quite difficult to get a personnel worker 
to state clearly what his objectives are in 
performing his functions. The “whys” are 
pretty fuzzy. Since a distinction between 
what is “service to” students and what is 
“control over” them is, according to our 
assumption, one source of internal conflict 
for personnel workers, it might be expected 
that this confusion would appear in self- 
descriptions of their duties. I suspect that 
this is not a deliberate manifestation. Sel- 
dom can I attribute it to open motives in- 
volving cynicism or duplicity. In effect, I 
imagine that most of this fuzziness in ex- 
pressed aim among personnel workers is 
actually subliminal. After all, if one never 
has to make alternatives clear to himself, 
he never has to make choices based upon 
the alternatives, and uncomfortable con- 
flicts thus never have to become manifest. 

For example, at the present time in many 
universities across the country, there stirs 
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an administrative concern over an increase 
in undercurrents of unrest and dissent evi- 
dent on their campuses, Sometimes the 
spirit of this restiveness is directed at a 
university administration, although much 
more often, I think, its originally-intended 
direction is toward more general aspects 
of social reform. Student personnel workers, 
as agents of control for these universities, 
are often directly involved in the business. 
Their job is to assist in the preservation of 
the existing social unit. Again, they find 
themselves torn between their humanitarian 
and their control values, and are in conflict. 
One thing that happens often enough is 
that personnel workers, in an attempt to 
establish the righteousness of their con- 
trolling behavior, tend to view student 
unrest as indicating the deterioration of a 
desirable, or even perhaps a universally 
“true” value system. Dissident student ac- 
tion is thus held to be destructive, the 
implication being that benign social mo- 
tives are under attack. Righteousness hav- 
ing been thus established for themselves, 
but in the position of members of a be- 
leaguered tactical force, personnel workers 
can now feel free to band together against 
the pressure, utilizing all available re- 
sources collectively to react against the 
unrest. 

Personnel workers as a group tend, it ap- 
pears, to look upon a university community 
as a hierarchy of controls, descending in a 
direct line of authority from a society, 
through a president, and on down to the 
students. This represents an organizational 
viewpoint which implies compliance to con- 
trol, or conformity, as an expected end. In 
this kind of world, one is supposed to func- 
tion with respect to what the “upper eche- 
lons” prescribe. 

This point of view is in marked contrast 
to the one expressed by many (but not all) 
faculty members—that a university is es- 
sentially a group of scholars joined together 
in coalition, with the mutually-held intén- 
tion of acquiring and passing on knowledge. 
Societal support, according to this latter 
view, stems from a social recognition of 
the need for such scholarly activity. In this 
perception, administration is simply an aid 
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to the scholars, “running interference” for 
them in their attempts to achieve their 
aims, rather than being,controllers of their 
behavior. This concept of a university an- 
ticipates the probability that the supporting 
society will, at times, be mildly upset by the 
existence of this subculture in its midst, 
but the expectation is that the felt need 
for it is greater than the desire to eliminate 
it, so it is permitted to remain in existence. 
Such faculty as adhere to this view are 
willing to predicate their continued exist- 
ence upon this premise. 

The resulting difference in philosophy 
between such faculty, on the one hand, and 
administrative and _ student personnel 
groups on the other, represents a real bar- 
rier to mutual acceptance and understand- 
ing on the campus, and is the source of 
much concern and potential conflict. 


Their Professional Education 
Unrealistic 


Many younger student personnel workers 
with whom I have talked reveal a painful 
upending of expectancies regarding the ac- 
tual job of a personnel worker. They seem 
to feel that the theory and the formal 
training to which they were exposed prior 
to their employment were only distantly 
related to the actual work, as they dis- 
covered it upon employment. If we are to 
regard such expressions of workers serious- 
ly, we must then entertain the possibility 
that much of the formal training for per- 
sonnel work is misplaced. Many younger 
student personnel workers, and some of 
those in training for these jobs, for instance, 
seem to feel that in their experience, the 
requirements of what amounts to some 
level of a counseling psychology training 
program are of little use to them practically, 
and that such requirements are often over- 
emphasized in their programs. On the other 
hand, they say, the managerial, manipula- 
tive or “administrative” aspects were not 
emphasized enough. Some young personnel 
workers seem, in fact, to believe that their 
training programs were not completely hon- 
est with them in this respect. The worker, 
in their view, starts his training in per- 
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sonnel work because he is motivated to do 
so by personal needs, interests and desires, 
mostly of a humanitarian nature. This ex- 
pectation is reinforced by the training pro- 
gram, which promises him that these ideals 
are indeed the ideals of personnel work, and 
his personal expectations will be thus cer- 
tainly fulfilled by the work. Then come 
the conflicts of the job! Many of these 
young people seem to feel that there just 
is not enough “in it” for them, in terms of 
personal satisfaction, reward, and recogni- 
tion to remain indefinitely in student per- 
sonnel work. There just are too few in- 
trinsic rewards. But by the time they start 
to work, they are too heavily invested by 
the extent and specificity of their training 
to seek other kinds of endeavor. Blocked by 
the investment in their training to seek other 
work, and unable to gain intrinsic satis- 
faction from personnel work itself, they 
often, it seems, turn to more opportunistic 
and pragmatic means of gaining reward. 
More often than not, this involves “getting 
ahead” in the only way left to them—as a 
full-fledged administrator frankly aligned 
to the demands of the organization. 


Thus selection, training and job place- 
ment would appear to be problems for 
student personnel organizations. But with 
the covertness of the control functions, the 
minimal visibility with which much of the 
functioning is performed, with the need to 
deal with role conflicts by rationalizing 
actions after-the-fact and by avoidance, 
how could it be possible to “teach” the 
realities of personnel work to trainees? How 
can concepts be taught when even the 
teachers are defending themselves against 
conflicts which might be brought about by 
clarifying the material? 


Personnel Worker, Teacher, 
Administrator? 

A somewhat related issue dealing with 
training and practice alike, is reflected 
in a theme that recurs through talk among 
personnel workers. This theme is to the 
effect that academic work and student per- 
sonnel work are really in some way differ- 
ent entities on a college campus. While 
there usually is, to be sure, great haste to 


ig 
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state that both campus groups are inter- 
ested in the same outcomes, the outcomes 
are never clearly articulated by personnel 
workers, nor is the feeling of singleness 
of purpose very emphatically expressed. In 
thinking over what personnel people actual- 
ly say, one gets the distinct feeling that in 
their deepest hearts, they really see their 
world as being different from that of faculty 
in matters related to philosophy, aims, and 
purposes. Overtly, singleness of purpose is 
professed, although once in a while, the 
existence of a split is admitted. 


Even the people who admit that such a 
rift exists, however, profess to be puzzled 
by it, reasoning that after all, both faculty 
and personnel people are teaching students. 
A typical reaction from a student person- 
nel worker might be, “Don’t our students 
learn about life in the living unit, the self- 
government group, or the counseling inter- 
view, as much as in the classroom?” No 
one, it seems, is willing to entertain the 
hypothesis that this split—if indeed one 
exists— might be due to the fact that both 
faculty and student personnel people are 
teaching, and that the propositions ad- 
vanced by the personnel workers concern- 
ing the nature of man and the realities of 
his social and physical environment, might 
be at odds with those being presented by 
faculty. 


A hypothesis that might be worth carry- 
ing further is that one reason for the con- 
tinued development of personnel work on 
college campuses is that personnel workers 
serve as buffers between the relative con- 
servatism of the supporting society, and the 
more innovative, questioning activities 
usually associated with faculty. Personnel 
people tend to balance out the cultural 
lag. They tend to reassure the surrounding 
society that it will not become unduly dis- 
arranged by the university's contact with 
students. Personnel workers thus become 
the guardians of the culture on the campus. 
They emerge as the present-day secular 
priests of education, whose function it is to 
reinterpret knowledge to students in ac- 
cordance with a particular society’s present- 
ly-existing mores, values and habits of be- 
havior. The existence of such people on 
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the campus makes the educational enter- 
prise socially palatable to a society present- 
ly confused by change and external threat. 
They aid the faculty by keeping such fac- 
ulty from having to deal directly with the 
social outcomes of their teaching and re- 
search. They aid administration by being 
trustworthy-type people whose presence 
balances things out and minimizes trouble 
in the system. 

Personnel people thus are useful to fac- 
ulty, administration, and culture alike. 
There are areas of sensitivity, however, 
where the symbiotic living together of 
faculty and personnel worker might con- 
flict. The academic hosts might be expected 
to nurture the personnel workers in their 
midst, so long as the personnel workers 
continue to serve the buffer function. As 
soon as the personnel worker's teaching ac- 
tivity begins to threaten the faculty’s intel- 
lectual control in the university community, 
however, it might be expected that the sym- 
biotic balance would be disrupted and 
trouble would develop. At the point where 
faculty discomfort became noticeable to 
a sufficient proportion of them, sharp fac- 
ulty counter-moves might be expected, to- 
ward an attempted resumption of the intel- 
lectual control of the academic community 
that they feel is their heritage. On some 
campuses presently, there are indications, I 
think, that the balance is swinging in the 
academic direction, and conflicts among 
personnel workers are thus mounting as a 
result. 
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Personnel work, I submit, is headed for 
some very rocky times. It is beset on all 
sides by conflicting social and psycho- 
logical demands. Personnel workers must 
begin to make choices—difficult as they 
may be. Personnel people cannot please 
everybody. There are going to be dissenters 
to whatever is done, and these dissenters 
are going to have to be dealt with. And the 
more ambiguous the motives of personnel 
workers appear to be to others, the greater 
the number of objectors there will be, and 
the more diverse the quarters from whence 
the objections will come. 


Personnel workers are going to have to 
institute more forthright and articulate 
methods for telling themselves what they 
are doing. They will have to assume more 
open and introspective attitudes regarding 
their work. They will have to become more 
outspoken in telling others what their duties 
actually involve. 


Lastly, but perhaps most importantly of 
all, they will have to find better ways to 
reward the few more able, autonomous, and 
personally secure functionaries in their 
midst. Perhaps in this way, over time, 
they will gradually people their field with 
professionals more resourceful and able to 
take the forthright measures needed to 
evolve personnel work into something 
which more closely resembles a genuine 
and identifiable profession than is present- 
ly the case. 


Received December 1, 1961. 


Comment 


So it has occurred to some psychologists 
that the way to clarify the status of coun- 
seling psychologists is not to argue, not to 
speculate, but to look and to count! It is 
good to see the Tyler-Wrenn-Tiedeman 
precedent perpetuated, and with such rele- 
vant data. 

Do counseling psychologists counsel? 
Yes, more than a quarter do this as their 
main activity. With those who teach and 
direct (and who, in many situations we 


know, give some time to counseling) they 
account for nearly three-quarters of the 
counseling psychologists sampled. 

Do counseling psychologists affiliate with 
(and therefore show evidence of identify- 
ing with) organized counseling psychology? 
Not as much as we might like, for al- 
though more than three-quarters of them 
belong to APA, less than one-quarter be- 
long to the Division of Counseling Psy- 
chology. But, in so far as they affiliate with 
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a specialty, it is counseling psychology, for 
less than a twentieth belong to the (com- 
peting?) Division of Clinical Psychology. 

Do counseling psychologists do research? 
Relatively few counseling psychologists 
(by training) are primarily researchers. Is 
this surprising? If measurement or develop- 
ment interest a psychologist more, he is 
not likely to enter counseling training—he 
can get a degree sooner as a psychometri- 
cian or developmental psychologist. If it 
is the counseling process that interests him, 
he will probably be interested in doing 
counseling, and research in it will be a 
minor. 

Do counseling psychologists engage in 
private practice? Not as a major activity. 
Most work in colleges and universities, the 
next largest group in hospitals—three-quar- 
ters are thus accounted for. We share our 
knowledge with, apply our skills to, many, 
not a few. 

Peterson and Featherstone have done us 
a service by bringing out these facts. But 
one minor misinterpretation should be 
noted: no “trends” are shown, for there are 
no comparisons over time, although there 
is a demonstrated present tendency for 
counseling psychologists to take certain 
kinds of jobs. 

If some psychologists remember to count, 
others, it seems, fail to read. Brigante, 
Haefner, and Woodson failed to read the 
1952 reports of the 1951 Conference on 
Training in Counseling Psychology, and 
conclude that this specialty was born five 
years later, in 1956; they ascribe (second 
paragraph) another Division 17 report to 
the APA; and it seems strange to read of 
clinical psychology being in its “infancy in 
the 1940’s” when it was celebrating its 50th 
birthday, no matter how phenomenal its 
growth since then! We should not, because 
of the recency of the use of the term coun- 
seling psychology and the newness of our 
institutionalization, assume that history be- 
gan with us. It can be found in books and 
journals. 

There is another kind of lack of perspec- 
tive which is a bit bothersome in this 
article: the practitioners are all VA coun- 
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selors or clinicians, other types of agencies, 
including the many college and university 
counseling centers, not being represented. 
And yet they are an important element in 
our specialty, and may see and be seen 
differently. 


As Brigante and colleagues point out, 
their finding that clinical psychologists 
think they are better psychologists than are 
counseling psychologists is in line with the 
Granger pecking order study. To counseling 
psychologists this is regrettable, whether it 
means that clinicians are biased or that 
counselors are modest. But let’s keep our 
historical perspective: the latest arrivals are 
generally looked down upon by older and 
better established groups, whether occupa- 
tional, ethnic, or religious. The fact that 
we, as counseling psychologists, are one of 
the newest specialties and are therefore 
viewed with some misgivings or disdain by 
those who were themselves recently looked 
down upon (and still are looked down upon 
by certain pertinent others) should cause 
us no great concern. It should merely stimu- 
late us to make doubly sure that we do 
have our own professional house in order. 
If we have merit, it will in due course be 
recognized through our deeds. 


Correll raises the important and persist- 
ent question of the role of the student per- 
sonnel worker, a question which arises from 
lack of clarity as to whether the SPA man 
is a counselor or an administrator. Often 
trained as a counseling psychologist, or as 
a guidance specialist with an emphasis on 
counseling, he aspires to an accepting and 
permissive role, only to find that he is cast 
in the role of administrator. 

Perhaps the moral of Correll’s paper is 
that we need to help graduate students 
decide, early in their preparation, whether 
they are going to be counselors or admin- 
istrators, and then differentiate the training 
programs. This could result in better trained 
counselors, prepared as counseling psy- 
chologists, and in better trained administra- 
tors, prepared in the manipulation of en- 
vironmental resources for the attainment 
of educational objectives. Perhaps, too, we 
have neglected the training of counseling 
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psychologists in the use of the environment, 
stressing too exclusively the personal inter- 
action of the interview as the method of 
counseling. But this latter possibility is 
surely not the complete answer if, as Cor- 
rell points out, the student personnel ad- 
ministrator is the buffer between the facul- 
ty and the public, charged with keeping 
students from getting out of line as a result 
of contact with the faculty. Correll points 
up the administrative, manipulative, control 
functions. There are two types of control, 
and the differences between them should 
be recognized and their training implica- 
tions acted upon. 

One aspect of the control function is in- 
ternal. The college or university must pro- 
vide resources which will help the student 
to develop and strengthen his own inner 
controls. These resources include the coun- 
seling psychologists who, in group and 
individual counseling, help students achieve 
personal integration and to resolve the 
conflicts created or aggravated in them by 
the challenges and stimuli of intellectual 
and social freedom on the campus. 
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The second aspect of control is external. 
The institution sets up rules and regulations 
which it enforces, and it provides resources 
that are designed to make it easier for stu- 
dents to conform with policy and to accept 
the disciplines of group life. These policies 
and regulations, these facilities and pro- 
grams, are administered by student per- 
sonnel administrators, the official repre- 
sentatives of the academic society in which 
students live. 

It will be a contribution to the resolu- 
tion of role conflicts on the campus and to 
the improvement of student personnel 
services (counseling and administrative) to 
recognize the distinctive nature of these 
roles, to define the relevant types of train- 
ing, and to help graduate students choose 
between them while still in training. To 
some extent we do this now. We can do it 
better. 


Donald E. Super 
Columbia University 
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En Garde Touché 
Repressed, robot man. Repressed, naive woman.; 
Dutifully performing the experiences Seeking real persons 
of your carefully set life. worthy of your gift. 
Oblivious to the contradiction What does it mean to be a person? 
of your living to the values you hold. To value you. 
Contradictions screaming at you You need a person 
through the fences you build. to help you be a person? 
What does it mean to be a person? Then don’t try to carve one 
To deny and distort what is real inside you. from every lost soul 
To rationalize—no, glorify suppression. who crosses your path. 


To teach “courage to be one’s self” 
as an intellectual concept. 


Run like mad. 

Add another layer of fence 
ere you hear a voice outside: 
your own. 


Reward 
At first 
I had not the strength 
to deny myself 
the pleasure of remembering. 


Then I destroyed the emotion " 
(because it was master of me) 
and substituted an armor 

of my own creation. 


Now the memory 
is nebulous and irrecoverable. 


I offer myself 

this evidence of accomplishment 
to ease the mysterious gnawing 
which never ceases. 








“What Do the Listeners Hear? .. .” 


We seek to understand, to know them. We listen to them. Yet some thoughts seem 
too little to be told, perhaps such vignettes as these. And if they told us, how much would 
we hear—only as much as is a part of us? 


Yesterday I slew dragons, 
sought the Holy Grail, 
and swam the Hellespont 


for my love. Please don’t explain 
me to me. 

Today I sit in my front porch rocker Can’t you understand? 

telling myself this ennui I hurt inside. 


is my new maturity. 


But where is my love? 














You are one of us now. All-forgiving, all-enduring. 
You say the words Dear one, you give too much. 
with the proper tone To understand but need no understanding, 
and inflection, to give strength, never knowing weakness— 
implying a careful appraisal How can I love you? 
that was never made. You deny my chance to be a man. 
No, it isn’t because you want me What happened? I— 
to discover myself so carefully avoiding 
that you deny me answers. conflict, 
You don’t know, either. so cleverly shaping 
moments for memories— 
No one who thinks he knows gave only what he asked. 
can resist telling. Why didn’t it work? 


Note: The Editor found these and asked for the privilege of publishing them. They are for coun- 
selors surely—they »re for all of us who deal hesitantly but compassionately with others. The author 
is on the staff of the University of Pittsburgh. 
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Secondary school guidance and counsel- 
ing services are said to exist for the purpose 
of helping students realize maximum de- 
velopment of their potential. Such a pur- 
pose gives very little specific direction 
to the organization of guidance and coun- 
seling functions or to the systematic evalua- 
tion of such functions. In fact, there does 
not seem to be any set of specific objec- 
tives or theoretical framework which could 
provide this direction. Ginzberg noted this 
when “after a comprehensive study of the 
literature of vocational guidance,” he con- 
cluded “. . . that the movement was severe- 
ly handicapped because investigators and 
practitioners were working without the help 
of any theory at all or with severely limited 
theories” (Ginzberg, 1952). 

What often appears to pass for a theory 
are sets of basic principles drawn from 
philosophy, psychology, and _ sociology. 
These principles are helpful in promoting 
an understanding of the guidance process 
in general, and of individual behavior in 
particular, but they do not constitute an 
adequate frame of reference. The assump- 
tions are not specifically related to each 
other, nor are they empirically related to 
observed practice. This eclectic approach 
to counseling is described by Tyler in a 
recent article (1958). However, as pointed 
out by Pepinsky, even when such an expert 
as Leona Tyler organizes a set of theoreti- 
cal principles the statement does not pro- 
vide a “. . . proposition or an attendant 
prediction that is testable in the public do- 
main” (Tyler, 1958, p. 9). Lacking a coher- 
ent theoretical proposition most guidance 
programs continue to operate on untested 
assumptions toward untestable objectives. 


Coladarciss comment about teachers and 
administrators applies to counselors in these 


programs who often plan and perform 
specific acts designed to produce some 
favorable outcome but who “. . . frequently 
are unable to verbalize an explicit rationale 
for the operations that define their func- 


tions” (Coladarci, 1959, p. 3). 


Why Decision-Making? 

Since this paper is suggesting that the 
absence of a theoretical framework for 
secondary guidance services is the greatest 
deterrent to development and research in 
this field, such a framework will be pro- 
posed. This framework must relate all as- 
pects of secondary school guidance into a 
correlated whole, it must be objective, it 
must give direction to procedures, methods, 
and techniques to be used, and it must 
provide for the derivation of testable hy- 
potheses which serve as a base for evalua- 
tion. 

Decision theory seems to have the most 
promise for suggesting such a frame of 
reference for school guidance and counsel- 
ing practice. Our society continually con- 
fronts people with situations where they 
must choose between alternate courses of 
action. Tyler suggests that “a person to 
some extent shapes the pattern of his life 
by the choices and decisions he makes at 
successive stages” (Tyler, p. 6). As was 
stated in the opening sentence of this paper, 
the broad goal of counseling and guidance 
is purported to be to help students in mak- 
ing potentialities into realities. However, 
there are far fewer realities than potentiali- 
ties, so as Rothney points out “guidance 
is largely concerned with choices that in- 
dividuals make among present and future 
actions” (Rothney, 1958, p. xx). 

Furthermore, when educational and vo- 
cational decision-making is seen as a de- 
velopmental process rather than an act oc- 
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curring at a point in time, its significance 
as a framework for counseling is enhanced. 
Recently, occupational and vocational de- 
cisions as an interactional process have re- 
ceived a great deal of attention in the 
literature (Ginzberg, 1951; Katz, 1960; 
Super, et al., 1957; Tiedeman, 1960). Within 
this process there is continual interaction 
between decisions about the immediate 
future, the intermediate future, and the dis- 
tant future. On the one hand, the specific 
decisions about the immediate future are 
partly determined by the more vague de- 
cisions about the intermediate and distant 
future, whereas on the other hand, the 
decisions about the intermediate and distant 
future are continually being modified by 
the results of the more immediate decisions. 
All of these decisions are, of course, altered 
as a student learns more about himself and 
his environment. Through “decision-mak- 
ing counseling” students are required to 
learn about themselves and their environ- 
ment as this information is related to the 
decision, and by participating in the deci- 
sion-making process they can learn to make 
decisions more independently and accept 
the proper responsibility. 
Decision Theory 

Much of the work on decision and game 
theory to date has been in the field of 
economics and mathematics. However, one 
of the leading contributors to decision 
theory, Girshick, suggests the advantage of 
a decision-making frame of reference for 
school guidance. “Decision theory acts as 
a gadfly. .. .” He continues by saying that 
it confronts the practitioner with the fol- 
lowing precaution. “You cannot solve your 
problems unless you more clearly define 
your goal and the consequences of your 
decision” (Girshick, 1954, p. 463). More 
recently, Chernoff and Moses indicate that 
the applicability of decision theory “ 
ranges from almost all inductive sciences to 
many situations that people face in every- 
day life when it is not perfectly obvious 
what they should do” (Chernoff & Moses, 
1959, p. 1). 

A decision-making frame of reference 
will require that we define our objectives 
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clearly, collect data and analyze its rele- 
vancy, study the possible alternatives and 
evaluate the consequences. This serves to 
reveal guidance and counseling methods 
which are heuristic and coherent rather 
than only logical and eclectic. Now let us 
utilize decision theory to develop a con- 
ceptual frame of reference for school guid- 
ance and counseling. 


Proposed Decision-Making Framework 


All decisions in school guidance have es- 
sentially the same characteristics. There is, 
in the first place, an individual about whom 
a decision is required. There are two or 
more possible courses of action to be taken, 
and the decision is to be made on the 
basis of information. Cronbach and Gleser 
use this sequence for their model and 
suggest that a decision may be terminal 
(final) or investigatory (calling for ad- 
ditional information ). The investigatory de- 
cision becomes a cycle, involving. informa- 
tion gathering and decision making, until 
a terminal decision is made. The terminal 
decision may also suggest a cycle, since 
the outcome of such a decision may yield 
additional information which would serve 
to modify the result of the terminal decision 
(Cronbach & Gleser, 1957, pp. 16-27). 

Bross designs a “decision maker” requir- 
ing information as “fuel” and resulting in 
a recommended course of action. The proc- 
ess of deciding requires a “predictive sys- 
tem” (assessing the possible alternative 
actions, the possible outcomes, and the 
probabilities) a “value system” (weighing 
the desirability associated with outcomes), 
and a “decision criterion” (to integrate and 
select an appropriate action) (Bross, 1953). 

The model in Figure 1 incorporates the 
above processes and suggests the cyclical 
nature of decisions. Thus, the strategy re- 
quires knowing the alternatives and out- 
comes, applying a value scale, and evalua- 
tion. The “decision” may lead to collecting 
more data or to outcomes which alter the 
situation and require the application of a 
new strategy, or the outcome may alter 
the objectives, or achieve the purpose. A 
decision can be final only in the sense that 
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Fig. 1. The Sequential Decision-Making Process 
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an immediate goal is reached. But the 
achievement of this goal may itself influ- 
ence or modify other related choices. The 
counselor’s role in this process is to assist 
the student through the cycle. As Cronbach 
and Gleser point out “. . . it is necessary to 
distill from a limited quantity of informa- 
tion the most intelligent possible decision. 
The problem is to find the procedure which, 
in the time available, offers the greatest 
yield of important, relevant, and interpret- 
able information” (Cronbach & Gleser, p. 
132). 

Using the problem of educational plan- 
ning as an illustration, the model (Figure 
1) suggests a counseling plan. The objective 
would be to select an appropriate program 
of courses. Information related to the ob- 
jective would be organized and considered. 
Test results, previous course grades, inter- 
ests, and the relation of this decision to 
future choices are examples of data to be 
used. In order to discuss the possible out- 
comes of alternative choices and their prob- 
abilities it is essential to know something 
about the degree of relevancy these data 
have for each alternative. What is the 
empirical basis for the relevance of a par- 
ticular datum for a specific decision? Can 
success be predicted? Would other data be 
more suggestive? These and other questions 
are part of the strategy. Then the possible 
outcomes are evaluated in terms of some 
scale of desirability and the actual selection 
of a decision is made utilizing a criterion 
based on the purpose. 


Bross suggests that this notion of decision- 
making presupposes a way of looking at 
the real world. That is, in judging any sys- 
tem or a decision the test is: does it work? 
The court of final appeal is the result in 
the real world. This pragmatic principle, in 
turn, presupposes that the individual has a 
value scale and requires the individual to 
compare one group of situations with an- 
other group. The use of the pragmatic 
principle assumes that what has been suc- 
cessful in the past will continue to be 
successful in the future and that experience 
(direct and indirect) will be used in assess- 
ing alternatives (Bross, pp. 29-32). 
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Although the problem of individual value 
scales is extremely complex and will not 
be discussed in detail, one comment from 
the field of philosophy is offered. Thomas 
shows us that valuing can be conceived as 
an active transaction between desires and 
certain conditions leading to anticipated 
consequences. Our decision-maker must be 
careful not to commit what is called the 
“positivistic fallacy’—equating the desired 
with the desirable. “Something is consid- 
ered valuable and desirable (not merely 
desired) when it is wanted in the light of 
perceived relationships to other things of 
interest” (Thomas, 1956, p. 220). Thus, 
when the possible outcomes are evaluated 
in terms of chances of success, the same 
odds have different meanings for different 
individuals or for the same individual under 
varying circumstances. 

The use of a decision-making framework 
is actually the application of the scientific 
method. To many people this proposed 
framework for school guidance involving 
collecting data, prediction, probability, and 
evaluation will suggest excessive interven- 
tion and control. But guidance does not 
want to control. Nor does this framework 
tell us what the content of an individual’s 
choice should be; rather, it indicates a proc- 
ess of choosing. Using this proposed proc- 
ess, a student’s “freedom of choice” is ac- 
tually increased. Rather than choosing from 
only perceived alternatives evaluated with 
subjective bias, the student (with the coun- 
selor’s help) will analyze what is likely to 
be misleading and irrelevant, will collect or 
observe new data which may suggest new 
alternatives, and will empirically determine 
the utility of each outcome (See Edwards, 
1961; Luce & Raiffa, 1957; and Thrall, 
Coombs, & Davis, 1954, for a good discus- 
sion of utility theory). Therefore, the stu- 
dent has more “free choice” since he is 
aware of more alternatives and has an in- 
creased understanding of the factors in- 
volved in choice, including his determina- 
tion of the desirability of the consequences. 
A “good” decision, then, is one involving the 
above process when the decider is willing 
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to accept the responsibility for the con- 
sequences. 

Many aspects of this framework need 
further clarification, such as value and util- 
ity. Other concepts have not been men- 
tioned which may need to be incorporated 
(risk, maximum gain, etc. ). Such discussion 
is beyond the scope of this paper. 


Implications for Guidance Practice 


The implications of this sequential de- 
cisionszmaking process as a framework for 
counseling and guidance practice are im- 
pressive. First, one basic assumption is 
required: the collection and utilization of 
relevant and reliable information is essen- 
tial for realistic decision-making. Second, 
the broad, general purpose of secondary 
counseling would be to utilize decision- 
making opportunities for developing the 
student’s capacity for subsequent decision- 
making. This would require that counselors 
help students learn to clarify alternatives, 
to pick out pertinent data, to use these 
data in their decisions, and to take responsi- 
bility for the decisions. Third, it seems gen- 
erally agreed that one of the most frequent 
problems encountered by guidance per- 
sonnel is the inability of students and par- 
ents to assess accurately the probabilities 
of given alternatives and/or the lack of 
knowledge of the complete range of pos- 
sible alternatives. 

The cause of the problem is also well 
known-selective perception. As Michael 
Demiashkevitch’s motto, adopted by the 
School of Scientific Police in Paris, tells us, 
“The eye sees in things what it looks for, 
and it looks for what is already in the 
mind” (Larrabee, 1945, p. 188). A counsel- 
ing and guidance program based on the 
decision-making framework, accepting the 
assumption that relevant and reliable in- 
formation is essential, and utilizing the 
broad purposes stated above, would be 
designed to teach students Dewey’s reflec- 
tive thinking (Dewey, 1933) and to en- 
courage them to be tentative in their con- 
clusions. Students (and parents) would 
learn that an appeal to empirical data is 
essential to establish any generalization. 
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Larrabee suggests that the same prob- 
lem exists in all human nature. “Man’s na- 
tural state is not doubt, but credulity—a 
combination of suggestibility in the face of 
whatever is clearly and strongly presented, 
and the will-to-believe whatever is person- 
ally or socially congenial.” “Doubt is some- 
thing which we have to achieve, and usual- 
ly we have to be driven to achieve it, some- 
times at a considerable cost to ourselves. 
Positive doubting is a skill which has to 
be acquired, and human children, no mat- 
ter how anti-suggestible they may be, are 
necessarily unskilled doubters pitted against 
the massive forces of social orthodoxy” 
(Larrabee, pp. 42, 67). Therefore, a third 
implication of this framework for second- 
ary guidance services is its potential for 
attacking one of the greatest problems of 
school guidance—“unrealistic expectations.” 


Another important connection with coun- 
seling practice is the framework’s attention . 
to the interaction among immediate, inter- 
mediate, and future decisions. That is, 
counseling will attempt to help the student 
utilize the more immediate decisions fac- 
ing him for the purpose of reality testing 
and modifying his developing self-concept 
and thus influence his decisions about more 
ultimate goals. Guidance practice would 
also attempt to see that the more immediate 
decisions offer the student opportunities to 
expedite movement toward his ultimate 
goals, however vague and tentative or 
broad the goals may be, and counselors 
would see that the decisions about ultimate 
goals help provide students with a more 
coherent direction through the multitude 
of immediate decisions they must make. 

A fifth implication: the framework would 
require guidance personnel who use the 
decision-making model (Figure 1) to be 
aware of all alternative actions and out- 
comes, to be able to supply information and 
to analyze its relevance and reliability, and 
to assist the counselee in the evaluation of 
outcomes against a known criterion within 
a value system. The application of this 
fifth implication will suggest methods of 
hiring and training personnel, techniques 
of collecting and utilizing guidance data, 
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ways of organizing the sequence of planned 
guidance activities, and procedures for in- 
dividual counseling. 

Finally, the use of such a decision-making 
framework will offer a baseline against 
which the guidance program and its prac- 
tice can be evaluated. Does the program 
provide relevant and reliable information? 
Are the possible alternative actions and 
outcomes presented? Are the probabilities 
and desirabilities of outcomes made avail- 
ableP Are students encouraged to make 
decisions utilizing the process proposed? 
Then, the effectiveness of the program can 
be evaluated by determining the degree 
to which students actually develop the 
capacity for subsequent decision-making 
and take responsibility for their decisions. 


Summary 


This paper has suggested that second- 
ary school counseling and guidance de- 
velopment has suffered from the lack of 
a compelling theoretical frame of reference. 
A framework was proposed and called 
“sequential decision-making.” Implications 
for guidance practice were presented. The 
framework needs further specification and 
clarification but perhaps possibilities are 
indicated even in its present form. Specific 
hypotheses which permit testing in actual 
school practice can be deduced. This is the 
next step in the further development of 
this framework. 


Received November 4, 1961. 
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Self-Evaluation and Academic Achievement 
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Norristown State Hospital, Norristown, Pennsylvania 


Despite continuing efforts to improve 
scholastic aptitude tests as predictors of 
early college grades, the obtained validity 
coefficients appear to have reached an 
asymptote in the area of about .50. A re- 
view of past research (Parres, 1955) and 
recent findings (College Entrance Exam- 
ination Board, 1957) indicates that one of 
our best predictors, the Scholastic Aptitude 
Test (SAT), can account for about 25 per 
cent of those variables that constitute early 
college grades. This fact has prompted re- 
searchers to explore the variance remaining 
to be identified. Of course, a portion of 
this undefined area is probably “chance” 
variation (test unreliability, criterion un- 
reliability, subject variability, etc.) but, 
as McQuarry (1953) has demonstrated, a 
major portion may also be said to include 
nonintellectual, nonaptitude, or personality 
factors. 

Much work has been done in attempting 
to identify some of these personality deter- 
minants of early college achievement 
(Cronbach, 1950; Dowd, 1952; Gough, 
1953; Griffiths, 1945; Hoyt & Norman, 1954; 
McQuarry, 1954; Owens & Johnson, 1949). 
For the most part, the work has been 
devoid of any theoretical orientation and 
the results only descriptive. 


The Problem 


This research was designed to investigate 
the importance of self-evaluation as a non- 
intellectual factor in scholastic achievement. 


1This paper is based upon the author’s Ph.D. 
dissertation (University of Pennsylvania, 1961). 
Grateful acknowledgement is made to James C. 
Diggory, Miles Murphy (now deceased), and Julius 
Wishner who served as dissertation committee 
members. Morris S. Viteles, dissertation super- 
visor, is due special thanks for his counsel, en- 
couragement, and patience. 


Theoretically, self-evaluation is defined in 
terms of the discrepancy between a self- 
perception and a concept of the ideal. 
Rogers and his group (Rogers & Dymond, 
1955) have firmly established the notion 
of general self-evaluation (self-ideal self 
discrepancy) in the area of self-concept 
theory. It appears that the larger the dis- 
crepancy the greater will be the degree of 
personality maladjustment. Research sup- 
porting this view can be found in Block and 
Thomas (1955), Butler and Haigh (1954), 
Chodorkoff (1954), Hanlon, Hofstaetter 
and O'Connor (1954), Smith (1958), and 
Turner and Vanderlippe (1957). 

If we accept the view that scholastic 
underachievement is a form of maladjust- 
ment, then we would expect potential 
underachievers to start their academic pro- 
gram in college with lower general self- 
evaluation than would potential achievers. 

On the other hand, self-evaluation may 
be specific in nature; that is, subjects pro- 
duce different self-descriptions when asked 
to view themselves in a general way than 
they do when asked to view themselves 
within a specific context (Rosen, 1956; 
Borislow, 1958). Thus, the subject’s per- 
ception of himself as a student was of con- 
cern in this research and was based upon 
a student self-ideal student discrepancy. It 
was assumed that students would begin 
their college career with uniform student 
self-evaluation (regardless of eventual 
achievement level) but, after a semester’s 
work, that this would be higher for the 
achievers and lower for the underachievers, 

Further, Diggory (Diggory & Magaziner, 
1959) has added certain theoretical re- 
finements to self-concept theory. He be- 
lieves that it is imperative, especially for 
general self-evaluation change, for the sub- 
ject to value highly a specific goal and to 
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perceive himself to possess the specific 
“capacity” to reach the goal. Therefore, 
general self-evaluation should change only 
where student self-evaluation is high and 
academic achievement is a prime goal. 
Where these conditions are absent, no gen- 
eral self-evaluation changes are predicted. 
An additional consideration is suggested: 
self-evaluation change is dependent upon 
an accurate perception of the outcomes of 
behavior, i.e., a correct perception of suc- 
cess or failure. As will be seen, a check 
was made to determine whether actual 
achievement level corresponded with per- 
ceived level of success. 

In summary, it was hypothesized that: 
(1) achieving students will show higher 
general self-evaluation than underachieving 
students prior to academic performance, 
where scholastic achievement is a prime 
goal; (2) achieving students will increase 
and underachieving students will decrease 
their general self-evaluation from pre- to 
post-semester assessments, where scholastic 
achievement is a prime goal and student 
self-evaluation is high; (3) no difference 
will be found between achievers and under- 
achievers in terms of student self-evalua- 
tion prior to academic performance, where 
scholastic achievement is a prime goal; (4) 
achieving students will show higher student 
self-evaluation than underachieving stu- 
dents after academie performance, where 
scholastic achievement is a prime goal. 

The differences predicted above were not 
predicted in comparing achievers and un- 
derachievers who did not indicate that 
scholastic achievement was a prime goal. 


Method 


Measuring Instruments 

In order to obtain indices of general and 
student self-evaluation for each student, a 
modification of Fiedler’s 24-item adjective 
scale was used (Fiedler, 1958, pp. 64-65). 
Each subject completed the same 24-item 
scale four times (at one sitting) under 
different sets of instructions: general self, 
student self, ideal self, and ideal student. 
The semantic differential format of the 
scale (after Osgood, 1952) with its scaling 
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feature of unit equivalence (Messick, 1957) 
lends itself to easy computation of the two 
self-evaluation indices. Using the D statis- 
tic? described by Cronbach and Gleser 
(1953) and Osgood and Suci (1952), a 
measure of general self-evaluation was de- 
rived from the discrepancy between gen- 
eral self and ideal self responses. Similarly, 
a measure of student self-evaluation was 
derived from the discrepancy between stu- 
dent self and ideal student responses.* 

A second instrument used was the Stu- 
dent Behavior Description (Florence, 
1956). This inventory appears able to identi- 
fy which of five “goal areas” a student will 
be more inclined toward while in college. 
The areas are: A. Organizational leadership; 
B. Scholastic achievement; C. Ethical con- 
formity; D. Social acceptance; and E. Self- 
adjustment. For the purpose of this study, 
it is assumed that if a student obtains a rank 
of one or two (of the five goal areas) for 
scale B, Scholastic achievement, he is pre- 
disposed to strive for scholastic achievement 
as a prime goal (SA-High). If a student ob- 
tains a rank of 3, 4, or 5 for scale B, it is 
assumed that he is not predisposed to strive 
for scholastic achievement as a prime goal 
(SA-Low). 

Procedure and Subjects 

A questionnaire consisting of the Student 
Behavior Description, four adjective scales 
(self, student self, ideal, ideal student, in 
this order) and a personal history page was 
distributed to the entire September, 1958 
freshman class of the College, University 
of Pennsylvania, immediately prior to their 
first semester. Just after the semester, the 
scales were re-distributed to the pre- 
semester respondents. 

The experimental population was the 
freshman class that entered the College of 
Arts and Science in September of 1958. Out 
of 361 students, 197 completed both a pre- 
semester and a post-semester questionnaire 
and became the sample used in this study. 
The sample was divided into two groups, 
Achievers and Underachievers. This classi- 


2D= 
3Based on 10 of the 24 items selected by each 
student as being “important for student success.” 
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fication was based upon the extent to which 
the student achieved or failed to achieve 
a first semester grade point average (GPA) 
concordant with his aptitude test score 
(SAT total score). Specifically, the correla- 
tion between SAT total score and GPA was 
computed for the entire freshman class. 
This proved to be .39 (P<.01). By regres- 
sion analysis, estimates of GPA were calcu- 
lated for each level of scholastic aptitude 
(SAT total score ).* All subjects in the exper- 
imental population whose actual GPA fell 
below one-half of the standard error of esti- 
mate of GPA predicted by the regression 
formula were classified as Underachievers. 
All others were classified as Achievers. 
The two groups were further refined by 
distinguishing between Achievers and 
Underachievers who indicated an intention 
to strive for scholastic achievement as a 
prime goal and those who did not (this was 
accomplished via the Student Behavior 
Description). Four groups were then com- 
posed, for data analysis purposes: Achiev- 
ers (N=84) and Underachievers (N=21), 
both groups oriented toward academic 
achievement (SA-High); and Achievers 


(N=55) and Underachievers (N=26), 
these two groups not oriented toward aca- 
demic achievement (SA-Low). Eleven re- 
spondents were not included in the above 
groups since their total SAT scores were 
not characteristic of the class as a whole. 

The experimental sample (respondents ) 
was found not to differ from the class as 
a whole on the variables of SAT, GPA, and 
Scale B score® (chi-square tests of dist., 
P’s>.05). 

In addition, no differences were found 
between the two SA-High groups and be- 
tween the two SA-Low groups in terms of 
SAT scores (P’s>.05; Mann-Whitney U 
test), various demographic factors (father’s 
vocation, parents’ edugation, hours of out- 
side work, type of secondary school), fu- 
ture educational plans, and course load. 


Results 
Table 1 shows the mean General Self- 
Evaluation D scores obtained by the two 
groups characterized as striving for schol- 
astic achievement as a prime goal (SA- 
High) and for the two groups not so char- 
acterized (SA-Low). 


Table 1 


General Self-Evaluation D Scores* (Means) 




















SA-High> Groups Achievers (A) Underachievers (U) A-U Difference 
= N=21 

Pre-semester 9.20 8.69 51 (NS) 

Post-semester 8.34 8.52 .18 (NS) 

Pre-Post Difference .86* .17 (NS) 

SA-Low» Groups Achievers (A) Underachievers (U) A-U Difference 
1 N=55 —2 

Pre-semester 8.07 8.99 .92 (NS) 

Post-semester 7.85 8.36 51 (NS) 

Pre-Post Difference .22 (NS) .63 (NS) 

*P<.01. 





alt should be noted that high D scores are indicative of low self-evaluation and vice versa. 
bSA-High =— scholastic achievement motivation is high. 
SA-Low — scholastic achievement motivation is low. 


The above findings are represented graphically in Figure 1. 


5Since 288 students, of 361, responded to the 

pre-semester questionnaire, this group served as 

4The regression equation is; GPA=.002566 the basis of comparison for the scale B score 
(SAT total score) + .308. distribution. 
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Fig. 1. General Self-Evaluation mean scores for the achieving and underachieving 
groups. (SA-High and SA-Low indicate level of scholastic achievement motivation.) 


General Self-Evaluation 


Contrary to prediction, there was no sig- 
nificant difference between achievers and 
underachievers in general self-evaluation, 
where academic achievement is a prime 
goal (P>.05, Mann-Whitney U Test). In 
addition, no difference was obtained be- 
tween the two SA-High groups after the 
semester’s performance; these same findings 
hold true for the SA-Low groups both pre- 
and post-semester. 

Thus far, then, the findings indicate that 
regardless of the distinction between stu- 
dents having scholastic achievement as a 
prime goal and those who do not, no gen- 
eral self-evaluation differences can be 
found between groups of achieving and 
underachieving students either prior to or 
after one semester’s work. 

Unfortunately, it was impossible to test 
adequately the hypothesis that general self- 
evaluation should become more favorable 


following scholastic achievement and less 
favorable following scholastic underachieve- 
ment (where scholastic achievement is a 
prime goal and the subject has high student 
self-evaluation). Just two underachievers 
materialized with the traits noted in the 
parenthesis above. 

However, as will be seen below, SA-High 
achievers as a group are prone to evaluate 
themselves highly as students. Reference to 
Table 1 shows that they demonstrated a sig- 
nificant increase® in general self-evaluation 
(from pre- to post-semester assessments ) 
while the SA-High underachievers showed 
no change. 

Also of interest is the fact that the SA- 
High achievers begin the semester with a 
lower level of general self-evaluation 
(P<.05) than the SA-Low achievers and 
then increase their level to that of the 


6P<.01, Wilcoxon Matched-Pairs Signed-Ranks 
Test. 
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Table 2 
Student Self-Evaluation D Scores (Means) 








SA-High Groups Achievers (A) 


Underachievers (U) A-U Difference 





N=84 N=21 
Pre-semester 5.75 7.89 2.14* 
Post-semester 5.98 8.44 2.46** 
Pre-Post Difference .28 (NS) .55 (NS) 





SA-Low Groups Achievers (A) 


Underachievers (U) A-U Difference 








N=55 N=26 
Pre-semester 5.94 6.79 .85 (NS) 
Post-semester - 6.17 7.89 1.72" 
Pre-Post Difference .23 (NS) 1.10 (NS) 
*P<.01. 
**P<.001. 


(NS)=Not significant. 


SA-Low subjects on post-semester assess- 
ment (see Table 1 and Figure 1). Since 
the achievers do not differ from the under- 
achievers in terms of general self-evalua- 
tion, the above finding seems not to imply 
that the SA-High achievers have low gen- 
eral self-evaluation prior to performance; 
rather it appears that achievers who are 
motivated to strive for scholastic achieve- 
ment as a prime goal (SA-High) are so 
motivated because they may see scholastic 
achievement as a means to enhance their 
general self-evaluation. 

Student Self-Evaluation 

Contrary to prediction, the SA-High 
achievers demonstrated significantly higher 
student self-evaluation than the SA-High 
underachievers prior to the semester. 
(P<.01, Mann-Whitney U Test; see Table 
2 and Figure 2). No such difference was 
found between the two SA-Low groups. 

As predicted, the SA-High achievers had 
significantly higher student self-evaluation 
than the SA-High underachievers after the 
semester (P<.001). Similarly for the SA- 
Low groups, the achievers demonstrated 
significantly higher student self-evaluation 
than the underachievers on the post-semes- 
ter assessment (P<.01). 

Inspection of the results reported above 
on student self-evaluation, clearly indicates 
that the variables of (a) level of academic 
achievement and (b) scholastic achieve- 


ment as a goal are important concomitants 
of the level of student self-evaluation. In all 
cases where a significant difference was 
found between the groups of achievers and 
underachievers, the achieving group was 
characterized by higher student self-evalua- 
tion than the underachieving group. In ad- 
dition, whereas the achieving group (of the 
“scholastic achievement high goal” sub- 
jects) had higher student self-evaluation 
than the underachiever group both pre- 
semester and post-semester, only a post- 
semester difference occurred for the same 
comparison of the “scholastic achievement 
not a high goal” groups. That is, students 
who stated an intention to strive for scholas- 
tic achievement as a goal seem to indicate 
their level of achievement by reflecting it 
in their level of preperformance student 
self-evaluation. Such a situation is absent 
for those students who do not indicate 
an intention to strive for scholastic achieve- 
ment as a goal. 
Self-Perceptions of Success 

It was stated earlier that “appropriate 
feelings of success or failure” on the part 
of achieving or underachieving students is 
a necessary condition for self-evaluation 
between-group differences and pre- to post- 
semester changes. In order to evaluate the 
degree to which such “appropriate feelings” 
were present in this research, the following 
question was asked on the post-semester 


a i 
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Fig. 2. Student Self-Evaluation mean scores for the achieving and underachieving 
groups. (SA-High and SA-Low indicate level of scholastic achievement motivation.) 


Personal Data Sheet: “How would you rate 
your success as a student thus far?” The 
subject was asked to place a check mark 
in one of eight spaces rated from “Extreme- 


ly Successful” to “Extremely Unsuccessful” 


(four spaces for degrees of “successful” and 
four for degrees of “unsuccessful”). The 
responses were tabulated by two response 
categories: Successful and Unsuccessful. 
Table 3 shows the results of the tabulation 
for the SA-High and the SA-Low groups 
separately. 
Table 3 
Judgments of Degree of Student Success 


SA-High Groups SA-Low Groups 














A* U* A U 

“Successful” 66 8 37 4 
“Unsuccessful” 18 18 18 22 
(Py2<.001) (Py2<.001) 





*A and U denotes Achievers and Underachievers, 
respectively. 


Without a doubt, the perceived level of 
scholastic success corresponds with the 
statistically defined achievement level. This 
appears to be an obvious finding. How- 
ever, due to the nature of the statistical 
definition of achievement level (grades 
relative to aptitude), the student’s percep- 
tion of success or failure seems to involve 
not only a reaction to his grades, but also 
takes into account his feelings about his 
scholastic aptitude or capacity. 

Thus, the two conditions whose presence 
seems desirable for self-evaluation assess- 
ment were evident in the research. The 
first, acceptance of scholastic achievement 
as a goal, has been controlled by treating 
separately students who received a high 
rank on the “scholastic achievement as a 
goal” scale of the Student Behavior Descrip- 
tion, from those who received a low rank; 
and second, the correspondence of per- 
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ceived success level to actual achievement 
level (as reported above). 


Discussion 


The results of this research do not sup- 
port the contention that students who turn 
out to be underachievers exhibit lower gen- 
eral self-evaluation either prior to or sub- 
sequent to academic performance than do 
achievers. 

However, where students indicate an in- 
tention to strive for good grades, it is clear 
that those who turn out to be underachiev- 
ers possess a more pessimistic picture of 
themselves as students than do achievers 
both prior to and subsequent to academic 
performance. 

Where the intent to strive for good grades 
is not dominant, underachievers can be dis- 
tinguished from achievers in terms of low- 
er student self-evaluation only after schol- 
astic performance. No such pessimistic stu- 
dent self-perception exists prior to academic 
behavior for these underachieving students. 

Theoretically, it was expected that stu- 
dents who indicate an intention to strive 
for scholastic achievement (SA-High) and 
who rate their student “capacity” high 
should demonstrate significant general self- 
evaluation change in the direction of their 
level of academic achievement. It was im- 
possible to test the above view completely 
since there were very few SA-High under- 
achievers who placed high in student self- 
evaluation and, in addition, SA-High under- 
achievers devalue themselves as students 
when compared to SA-High achievers. 
Therefore, a comparison of general self- 
‘evaluation changes between goal-striving 
achievers and underachievers, who think 
highly of themselves in terms of student 
self-evaluation (“capacity”), was impossible 
because goal-striving underachievers - de- 
value their “capacity” as students. 

The achieving group (SA-High), how- 
ever, increased their general self-evaluation 
subsequent to successful student perform- 
ance while the underachieving group did 
not change. That is, failure in the exercise 
of a specific “capacity” believed to be weak 
had no effect upon the students’ feelings 
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of general worth. Success in the exercise 
of a specific “capacity” believed to be 
strong positively influenced the subjects’ 
feeling of general worth. 

Questions which prompt consideration 
for further research are apparent. Why does 
the underachiever, who has the ability and 
intent to achieve, along with favorable feel- 
ings of general worth, begin his first semes- 
ter in college with a negative student self- 
image? Is it the end effect of borderline 
experience in the way of educational 
achievement at the secondary school level? 
Or, if we assume that negative general self- 
evaluation is indicative of general personal- 
ity maladjustment, does this mean that the 
presence of negative student self-evalua- 
tion, in a sense, represents some type of 
specific personality maladjustment? If so, 
then future research dealing with personal- 
ity concomitants of scholastic underachieve- 
ment might best concern itself with the in- 
tegrity of the “student role” rather than 
with the “whole person.” 

This research is based upon hypotheses 
derived from two different approaches 
to self-evaluation theory. One approach, 
proposed by Diggory (1959), emphasizes 
the contribution of many self “roles” or 
“capacity” evaluations to the more global 
or general self-percept. The other approach, 
exemplified by the Rogerian group (Rogers 
and Dymond, 1955) emphasizes the rele- 
vance of a global or general self-percept to 
the efficiency of the person with no appar- 
ent attention to unique sub-‘roles.” The 
former theoretical view has proven more 
fruitful for this investigation into the non- 
intellectual factors of academic achieve- 
ment. 


Summary and Conclusions 


This study represents an attempt to 
determine the importance of self-evaluation 
as a nonintellectual factor in scholastic 
achievement. A distinction was made be- 
tween general self-evaluation and student 
self-evaluation. 

A representative sample of 197 students, 
of.a college freshman class of 361, replied to 
both a pre-semester and a post-semester 














Self-Evaluation and Academic Achievement 


questionnaire designed to yield indices of 
general and student self-evaluation. Four 
experimental groups were extracted which 
did not differ in terms of scholastic apti- 
tude, certain demographic factors, and edu- 
cational-vocational plans: achievers (N= 
84) and underachievers (N=21), both 
oriented toward academic attainment; and 
achievers (N=55) and underachievers (N 
=26), not so oriented. 

The following conclusions seem war- 
ranted: 

1. Regardless of an intention to strive 
for scholastic achievement as a prime goal, 
students who underachieve scholastically 
cannot be distinguished from those who 
achieve scholastically on the basis of gen- 
eral self-evaluation prior to or subsequent 
to their first semester in college. 

2. Students who underachieve scholas- 
tically have a poorer conception of them- 
selves as students than do achievers sub- 
sequent to their scholastic performance, 
regardless of initial intention to strive for 
scholastic achievement as a goal. 

3. Where students exhibit an intention 
to strive for scholastic achievement as a 
prime goal, underachievers have a more 
pessimistic conception of themselves as stu- 
dents than do achievers prior to their actual 
scholastic performance. This does not hold 
true where scholastic achievement is not a 
prime goal. 

4, Where scholastic achievement is a 
prime goal, where the student has a good 
conception of himself as a student, and 
where he does achieve scholastically, his 
general self-evaluation becomes more favor- 
able from pre- to post-semester assessments. 
This does not hold true where scholastic 
achievement is not a prime goal. 

The above findings were interpreted as 
lending support to the usefulness of a more 
specific (“role” or “capacity”) self-evalua- 
tion theory which takes into consideration 
relevant motivation. They do not support 
general self-evaluation, based on the global 
concept of personality adjustment, as a 
factor in investigating nonintellectual fac- 
tors in academic achievement. 
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Self-Concept Implementation 


in Occupational Choices 


Richard L. Morrison? 
University of South Carolina 


Within the realm of self-concept theory 
the question has arisen as to the relation- 
ship of self-theory to theories of occupa- 
tional choice. Super (1957) has postulated 
that occupational choices are best under- 
stood from the point of view of self-concept 
implementation through occupational roles. 
The individual may try to be logical about 
his decision by listing his interests, his 
abilities, his work experience and so on, 
but his feelings and attitudes enter into his 
decision making in subtle ways which are 
frequently not consciously recognized. 

The self-concept approach allows for the 
influence of factors which are marginal to 
awareness by assuming a kind of projection 
of self in total imagination into the occupa- 
tional role as perceived by the individual. 
The occupational role is “tried on” to see 
if it fits the self. The individual also tests 
the fit by examining his own feelings and 
assessing his adequacy in situations which 
call for the same personal characteristics 
perceived to be a part of the occupational 
role. This process of matching self and oc- 
cupational role is seen by Super to be cen- 
tral to goal setting and decision making at 
various choice points presented by the 
educational and prevocational environment 
of the individual. In contrast the tradi- 
tional test-oriented approach to vocational 
counseling assumed a much more rational 
decision-making process and failed to in- 
corporate emotional and unconscious ele- 
ments in motivation. 

The self-concept postulate, however, has 
been criticized as impractical because both 


1This study was done under a grant from the 
Northwestern Graduate School for which the 
author wishes to express appreciation. 


self concept and occupational role percep- 
tions are essentially subjective and are not 
accessible to standardized measuring instru- 
ments. The measurement problem is that of 
obtaining a quantifiable sampling of two 
phenomenological dimensions which can be 
related to each other, namely, the subjective 
perception of self and the subjective per- 
ception of occupational role. The present 
study explores the possibilities of adapting 
Q methodology toward the solution of this 
problem. The question under study is that 
of determining whether self-descriptions 
and occupational role descriptions done 
with Q sorts are valid representations of the 
subjective process postulated by the self- 
concept implementation theory. 


Method 


A group of first year nursing students 
were asked to describe themselves by means 
of a Q sort, following which they described 
their perceptions of a nurse and then their 
perceptions of a teacher. The same sort 
statements were used for all three sorts. 
It was hypothesized that their perceptions 
of a nurse would be more similar to their 
perceptions of self than would their percep- 
tions of a teacher. That is, if a girl has 
chosen nursing because her perception of 
the role is felt to be compatible with her 
self concept, then her descriptions of her- 
self and the occupational role to which she 
has committed herself should resemble each 
other more closely than her self description 
would resemble some other occupational 
role which she had not chosen. 

In order to determine whether the find- 
ings have any generalization value for 
occupations other than nursing, the same 
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sorts were obtained from a group of teacher- 
trainee subjects equidistant in time from 
presumed date of entry into their chosen 
occupation. All procedures were repeated 
upon this second group. 


Subjects 


The experimental group consisted of 44 
nursing students in their second semester 
of the first year of a three-year training 
program at the Evanston Hospital School 
of Nursing, Evanston, Illinois. The second 
group consisted of 43 education majors, 
primarily sophomores, in a spring quarter 
section of the course, educational psychol- 
ogy, at Northwestern University. All sub- 
jects were women. The two groups were 
approximately equidistant in time from the 
day they would presumably become work- 
ing nurses and teachers and were regarded, 
therefore, as being at similar vantage points 
in time with respect to relating their self- 
perceptions to those of the occupational 
role to which they were committed. 

Apart from the availability of these two 
groups as research subjects, they were se- 
lected because nursing and teaching repre- 
sent two occupations for women which 
have high role visibility, both require spe- 
cific training beyond high school, and both 
are very likely to be among the alternatives 
available for consideration by high school 
girls. Conceivably, any subject of either 
group might have chosen the other occupa- 
tion. The comparability of these occupa- 
tions with respect to all of these factors 
provides a finer test of the capacity of the 
Q technique for making discriminations in 
role perceptions than would be the case 
had more dissimilar occupational roles been 
chosen. 

The Instrument 

The basic requirement of utilizing an 
instrument which would provide a “meas- 
ure” of self-perceptions which would be 
directly comparable to a measure of oc- 
cupational role perceptions was met through 
the compilation of a set of Q sort state- 
ments. More specifically, each Q statement 
had to be applicable to the self-descrip- 
tions of young women, to the occupational 


role of nurses, and the occupational role 
of teachers. 

A pool of 350 items was gleaned from 
incomplete sentence forms with stems di- 
recting the respondent to make evaluative 
statements about himself, about teachers, 
nurses, careers, etc., and also from person- 
ality inventories. The item pool was ad- 
ministered to three groups which did not 
include members of the samples used in 
this study. An educational psychology class 
was asked to check the items which de- 
scribed their conception of a teacher and 
a group of nursing students were asked 
to do the same for a nurse. A group of 
freshman women enrolled in a general 
psychology class described themselves. On 
the basis of a simple frequency tally the 
80 most frequently chec’ed items for each 
group were compiled into three lists. Fifty 
adjectives were selected which were com- 
mon to all three lists. The fifty items se- 
lected were then mimeographed on plain 
3 x 5 cards and sorted into packs. 


Cronbach (1953) specifies three stand- 
ards for Q statements. The first is that all 
of the items must be relevant to the domain 
being described. It was with this require- 
ment in mind that the item selection pro- 
cedure outlined above was undertaken. 
Secondly, the items should apply to as 
many aspects or dimensions within the 
domain as possible. As a check on this re- 
quirement, the items were grouped by the 
investigator into categories which appeared 
to be implicit in the statements with the 
following results: physical description 
items such as “Neat in appearance,” 
“Healthy,” etc.; description of capacities 
items such as “Intelligent,” “Good Mem- 
ory, “Observant,” etc.; attitude items of an 
interpersonal nature such as “Like people,” 
“Mannerly,” “Sympathetic,” etc.; emotional 
status items such as “Feel life interesting 
and colorful,” “Self-controlled,” “cheerful,” 
etc.; task or work attitude items such as 
“Like school,” “Always conscious of work 
responsibilities,” “Realistic,” etc.; attitude 
items suggesting moral qualities such as 
“High ideals,” “Conscientious,” “Fair- 


minded,” “Desire to contribute to society,” 
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etc. Many of the items shifted categories 
and the categories themselves seemed to 
shift when the statements were grouped 
with respect to work situations and the 
role of the worker. On the basis of inspec- 
tion the items were regarded as sufficient- 
ly varied as to represent multi-aspect cov- 
erage of the three dimensions for which 
they would be used, namely, to describe 
self, a nurse, and a teacher. 

The third requirement specified by Cron- 
bach was that the items be capable of maxi- 
mum variability, that is, all items should be 
able to fall anywhere on the continuum and 
should not tend to be placed toward one 
end of the continuum rather than the other. 
This requirement was considered in select- 
ing statements for the item pool in that no 
negatively valued statements were included 
to eliminate the gravitation of particular 
statements toward the “least like me” end 
of the continuum. All of the qualities con- 
noted by the items are essentially positive 
qualities in judgment of the investigator. 
A check on the variability of items was de- 
sirable, however, since some qualities might 
be more positive than others. For this pur- 
pose the sorts done by ten teacher-trainees 
were analyzed as to the positions of each 
item on the ten sorts. All of the items ap- 
peared to vary adequately within the mid- 
dle seven points on the eleven-point con- 
tinuum. No item occurred in the extreme 
positions more than once on the ten sorts. 


Procedure 

The Q sorts were administered in May, 
1959, to both groups. After completion of 
the personal data sheet, the subjects were 
instructed in the procedure for throwing 
the Q statements to describe self on a 
continuum from “Least like me” to “Most 
like me” with a specified number of state- 
ments for each point on the continuum, 
1, 2, 3, 4, 7, 7, 8, 7, 7, 4, 3, 2, 1, forming a 
forced normal distribution. Following the 
first sort, the subjects were directed to re- 
peat the procedure to describe a nurse (or 
teacher) and were given another preshuf- 
fled pack of statements. The third sort was 
administered in exactly the same way as the 
second. 


The data were transferred to tally sheets 
immediately after each sorting which per- 
mitted the correction of incorrectly thrown 
cards. From the tally sheets, it was possible 
to compute directly the number of con- 
tinuum points each statement “moved” 
from its position on the self-sort. The sum 
of these points for each subject represents 
a discrepancy score. When the discrepancy 
score for the sorts, “self and own” occupa- 
tion was subtracted from the discrepancy 
score for “self and other-than-own” sorts, 
the resulting score is referred to as a “dif- 
ference score.” The significance of the 
deviation of the mean difference between 
discrepancy scores in a predicted direction 
from zero was tested. 


Results and Discussion 


The principal results are shown in Table 
1. The discrepancy scores are in inverse 
relation to the degree of similarity between 
self-descriptions and occupational role de- 
scriptions. In other words, the lower the 
discrepancy score, the greater the similarity 
between sorts and the greater the presumed 
identification with the occupational role. 
As is reflected in Table 1, the nursing 
trainees reflect greater identification with 
nursing than with teaching. The reverse, 
of course, is true of the teacher-trainees. 
The major hypothesis is regarded as sup- 
ported by these findings. The null hypoth- 
esis of no difference in self-own and self- 
other perceptions is rejected for both 
samples at the .01 level of confidence. 

By inspection, the mean discrepancy 
scores for the two samples suggest a dif- 
ference between the two samples. The nurs- 
ing group tends to describe both their own 
occupational role as well as other-than-own 
occupational role as more similar to self 
than did the teacher group. However, a 
test of the difference between the mean 
discrepancy scores did not reach statistical 
significance. Therefore, the two samples 
are not demonstrated to differ in degree 
of occupational identification as reflected 
by the relative sizes of the discrepancy be- 
tween role perceptions and self perceptions. 

Because the self sort was necessarily the 
first sort administered (in order to prevent 
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Table 1 


Discrepancy Scores for Self-Own and Self-Other Sorts and Differences Between 
Discrepancy Scores for Nursing Trainees and Teacher Trainees 








Mean SD t 





Nursing trainees (N=44) 
Discrepancy Scores 
Self-Nurse 
Self-Teacher 
Difference Scores: 
Self-Teacher minus Self-Nurse 
Teacher Trainees (N=48) 
Discrepancy Scores 
Self-Teacher 
Self-Nurse 
Difference Scores: 
Self-Nurse minus Self-Teacher 


105.68 
117.27 


17.18 
15.61 


4.63* 


21.86 
17.19 


111.51 
128.05 


5.47* 





*Significant at .01 level. 


the subjects from guessing the purpose of 
the study), the possibility of a persevera- 
tion from the self sort to the second sort 
must be considered. For this reason, 21 
nursing trainees and 14 teaching trainees 
threw the second two sorts in reverse order. 
That is, they threw for other-than-own 
occupational role before throwing for own- 
occupational role. This group is labeled 
the “Reverse Order” group. The remainder 


of the two samples, the “Regular Order” 
group sorted for self, for own occupation 
and for other-than-own occupation. Table 
2 reveals some perseverative influence. The 
Regular Order group reveals more similar- 
ity in sort concordance for self-own as op- 
posed to self-other and this similarity is 
lessened for the Reverse Order group. The 
t value increased for the Regular Order 
group to a value beyond that of either 


Table 2 


The Effect of Perseveration Due to the Sequence of Sorts, Regular Order and 
Reversed Order for the Two Samples Combined 








Mean SD ? 





Regular Order (Self-Own-Other) (N=52) 
Discrepancy Scores 
Self-Own 
Self-Other 
Difference Scores 
Self-Other minus Self-Own 


Reversed Order (Self-Other-Own) (N=35) 


Discrepancy Scores 
Self-Own 
Self-Other 
Difference Scores 
Self-Other minus Self-Own 


104.54 
122.04 


23.25 
17.45 


6.04* 


111.17 
123.48 


20.78 
16.57 


3.93* 





*Significant beyond the .0005 level of confidence. 
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original sample and conversely the t value 
decreased for the Reversed Order group 
(t = 3.93). The latter value, however, is 
still statistically significant and therefore 
the effect of perseveration does not nullify 
the support for the major hypothesis. That 
is, the greater similarity of own-occupa- 
tional role perception to self-perception is 
not due to perseveration from the self sort 
to the second sort. 

A second question of the study concerns 
the utility of the Q technique as a measure 
of occupational identification. For this pur- 
pose, the relatively greater similarity of 
self-own as against self-other is a less 
economical measurement possibility than 
using self-own similarity by itself to re- 
flect degree of occupational role identifica- 
tion. To be of value the self-own correla- 
tion would have to be sensitive to individual 
differences in degree of occupational role 
identification. 

Theoretically, both self perception and 
occupational role perception are somewhat 
fluid (Super, 1953). If a person anticipates 
or has definitely chosen to become a doctor, 
nurse, teacher, etc., he is motivated to per- 
ceive aspects of the role selectively in terms 
of a future “fit” for self. Identification with 
the role suggests that the person would 
tend to discover more and more aspects of 
the role as similar to self. Similarly, he 
would tend to bring into sharp figure those 
aspects of self similar to his perception of 
the occupational role. Presumably, this 
process is abetted by having time as well 
as opportunity to make such differentia- 
tions. Thus, one would hypothesize that 
greater concordance in self-own sorts would 


be associated with identifications of longer 
standing. To test this hypothesis, the two 
samples were combined. Then, those above 
the median for self-own similarity were con- 
trasted with those below the median to 
determine if they differed in duration of 
commitment. 








Table 3 
The Relationship of Time of Decision to Self-Own 
Correlation 
(N=87) 
7 Below Above 


Median Median 





Those choosing before 


high school 12 18 
Those choosing during or after : 
high school 31 26 


Chi square = 1.10 P<.15 df = 1 





As is clear from Table 3, the null hypoth- 
esis cannot be rejected at a satisfactory 
level of significance. However, the chi- 
square value does suggest a tendency for 
those having higher self-own correlations 
to have made earlier decisions. 

The degree of self-own concordance was 
also contrasted with degree of stated com- 
mitment to the occupation. Table 4 indi- 
cates that a statistically significant relation- 
ship does exist. This finding suggests that 
self concept implementation is a useful theo- 
retical construct and that self and occupa- 
tional role descriptions do reflect to some 
extent the degree of identification with oc- 
cupational role. While this evidence is ad- 
mittedly quite meager, it does imply that Q 
technique may be worthy of exploration as a 
device for tapping occupational motivation. 


Table 4 


" The Relationship of Self-Own Correlation to Stated Commitment to 
Own-Occupation for Combined Sample 











(N=87) 
Temporary To Return : Strongly 
Self-Own Correlation Commitment After Marriage Committed 
Above median 8 11 25 
Below median 12 17 14 


Chi square = 5.16 .05<P>.02 df = 2 
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Summary and Conclusions 


This study attempted to answer the ques- 
tion of whether the phenomenological ap- 
proach to the occupational choice process 
is a useful conceptual approach to occupa- 
tional choice motivation. Through obtaining 
Q sorts of self perceptions and of occupa- 
tional role perceptions, it was possible to 
test for the presence of a relationship be- 
tween these two phenomenological dimen- 
sions. A group of nursing trainees and a 
group of comparable teacher trainees de- 
scribed themselves, their chosen occupation- 
al role, and an occupational role they had 
not chosen. Both samples showed a signifi- 
cantly greater similarity between their self 
perceptions and their perceptions of their 
chosen occupational roles than between 
their self perceptions and their perceptions 
of an occupational role they had not chosen. 
It was concluded that this evidence sup- 
ports tentatively the self-concept imple- 
mentation theory of occupational choice. 

A second purpose of the study was to 
explore the possibilities of utilizing an 
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adapted Q technique as a measure of de- 
gree of occupational identification. The 
self and own-occupation r’s did not relate to 
time of stated decision to train for and 


‘enter the chosen occupation for the com- 


bined sample. That is, those reporting that 
they decided on their occupation during 
high school or earlier did not have signifi- 
cantly greater self and own-occupation con- 
cordance than those deciding later although 
the trend was in the predicted direction. 
The self own-occupation r’s did relate, how- 
ever, to stated degree of commitment to 
own-occupation. It was concluded that the 
evidence suggested partial support for the 
notion that Q technique has possibilities 
as a measure of occupational motivation. 


Received November 17, 1961. 
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Women Are More Predictable Than Men 


Harold G. Seashore? 
Test Division, The Psychological Corporation 


Women are more predictable than men. 
To dissipate some of the emotional over- 
tones and biases that this statement might 
induce, let me introduce some scientific 
caution. Women are more predictable than 
men—sometimes—in some ways. 

The data which I am about to discuss 
are ecological in nature; they are the re- 
sult of my walking in the psychometric 
forests and swamps collecting test validity 
coefficients. In this forest, or swamp, I 
wanted to collect a Galtonian hamper of 
Pearson rs which, when classified and 
ordered, might document a relationship be- 
tween sex and the size of coefficients of 
test validity. 


One Must Have Hypotheses 


So here is my first one—and, frankly, it 
was developed after the facts. I first gath- 
ered some Pearsonian flowers, I classified 
them, and I found that they fell in a cer- 
tain pattern. So then I wrote my hypothesis 
and began gathering some more data. The 
hypothesis is this: Academic grades of 
women in high school and college are bet- 
ter predicted from aptitude tests than are 
academic grades of men. 

We counseling psychologists cannot evade 
the matter of values. Even when working 
with numbers we try to be case-oriented. 
We know that our ego-functioning is deep- 
ly involved in all our researches. It follows 
that I need one hypothesis which is ori- 
ented to the researcher himself. It is this: 
The writer knows why women are more 
predictable than men in the academic 
realm. As you shall see, this hypothesis 
will have to be rejected. Pursuit of the elu- 
sive why will lead me only to the posing 

1Presidential Address, Division of Counseling 


Psychology, The American Psychological Associa- 
tion, September 1, 1961. 


of some questions which might lure others 
to seek explanations of the observations I 
shall present. 


The Problem and the Data 
How This Study Began 


It originated in the proverbial opening 
phrase of non-data-minded people: “Every- 
body knows. . . .” “Everybody knows psy- 
choanalysis works.” “Everybody knows stu- 
dents develop more character if they have 
to work their way through college.” “Every- 
body knows that a test which was de- 
veloped through factor analysis is better 
than a test based on analysis of a function 
and use of straightforward empirical test 
construction procedures.” “Everybody 
knows that psychotherapy is the heart of 
counseling psychology.” 

This character named Everybody seems 
to know a lot. “Everybody knows that 
women’s grades are more predictable than 
men’s.” School counselors tell me_ that. 
Managers of testing programs have said so. 
Still, I can’t recall having seen in any text- 
book on measurement, counseling, or edu- 
cational psychology any tables of data 
which support the assertion. I actually 
looked in a couple dozen fairly current 
volumes to see what had been said on the 
subject. I found nothing, so I didn’t seek 
any further. There is, of course, no use in 
preparing a long history section for this 
paper since “Everybody knows” that no 
editor of a psychological journal wants to 
waste space on what has been said before. 

This excursion looking for sex in the 
psychological swamps arose in part from 
studies by Berdie, et al. (1951, 1954) in 
which the present topic was an incidental 
part. A more recent study from Swanson 
and Berdie (1961) includes this summary 
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statement: “The test scores and high school 
percentile ranks observed here predict col- 
lege performances more effectively for 
women than for men.” In the body of the 
report, they say, “Of 30 possible compari- 
sons of men and women, 26 of the com- 
parisons show the multiple correlation for 
women is higher than for men.” 

Knoell (1961) has reported a study of 
the prediction of academic success in the 
California state colleges, but the detailed 
data were not available at this writing. 
She states, “Correlations between aptitude 
tests and freshman year grades were con- 
sistently higher for women than for men, 
at all colleges, with the differences in cor- 
relations at a number of colleges signifi- 
cantly different from zero.” She also re- 
ported that the coefficients of correlation 
between high school grades and freshman 
grades were higher for women. 


Sources of Data 

The data we want must meet certain 
specifications. Basically I wanted a large 
number of classes in high school and col- 
lege for which separate test validity co- 
efficients for men and women had been 
published. You will be surprised how few 
of these there are in the test manuals and 
in research articles. Despite the well-known 
fact that there are sex differences in the 
predictor tests and sex differences in cri- 
terion grades, most researchers just lump 
the men and women together in their re- 
ports. One substantial pool of validity co- 
efficients for high school students attending 
the same classes and reported by sex is 
in the Manual for the Differential Aptitude 
Tests (Bennett, et al., 1959). There is also 
a substantial pool of paired validity co- 
efficients in the Manual and Supplements 
for the College Qualification Tests (Ben- 
nett, et al., 1957). I shall also present some 
data from two recent articles by Juola 
(1960, 1961) as well as a little from an 
earlier article by Berdie, Dressel, and Kel- 
so (1951). 

The Differential Aptitude Test samples 
are defined in Table 1. Fourteen school 
systems supplied 18 class groups for whom 


criterion grades were secured in 65 courses. 
These courses were divided into three cate- 
gories—English, Social Studies, and Math- 
Science. Since there are eight DAT scores 
for each student, there are 520 comparisons 
of the validity coefficients available from 
the total sample. 


Table 1 


Groups and Criteria on Which 
DAT Validity Coefficients Are Based 


Grade Grades Total Pairs of r’s 











9 11-12 Compared 
Schools 1 8 14 
Class Groups 15 8 18 
Criterion Courses 54 1l 65 520 
English 20 6 26 208 
Social Studies 12 8 15 120 
Math-Science 22 2 24 192 





Before proceeding with the findings I 
must note that these 520 comparisons are 
not from independent samples. Ideally we 
should have only one pair of validity co- 
efficients for the students in one course, 
and for each such class we should analyze 
one predictor variable only. This sort of 
study can be done but would mean a lot 
of scrounging for original data in a large 
number of places. To secure a really prop- 
er sample of 500 comparisons we would 
need 500 schools, with the criterion grades 
in a variety of courses and at various grade 
levels, and, of course, with various predic- 
tors. But now we are ecologists; we just 
want to see what we can find in the swamp 
we are traversing. Table 1 classifies the 
pairs of mushrooms, anemones, and vines 
which we have collected in our hampers. 


The Data Show a Trend 

Results: High School 

Table 2 states the conclusion at the high- 
est level of generality. The summary data 
in the lower right-hand corner say that of 
the 520 comparisons, 61 per cent show 
higher validity coefficients for the girls than 
for the boys, 36 per cent of the cases show 
higher validity coefficients for boys than 
for girls, and 3 per cent have no differ- 
ences in the r’s. The percentages for grade 
nine are almost identical to the percentages 
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Table 2 
Direction of Differences between Corresponding 
Validity Coefficients of Boys and Girls 
By Subject Area and DAT Subtest 
Subject Area—Number of Instances Total 

Differential English Social Studies Math-Science Percentage 
Aptitude Tests Ga Ba Na G BN G BN G BN 
Verbal Reasoning ly Fs 3 3 is ea 68 26 6 
Numerical Ability It @=0 ll 4 0 14 8 2 65 32 3 
Abstract Reasoning 20 5] 9 § 1 1 8 1 68 28 4 
Space Relations 17 25.0 10 5 0 we  9¢.6 65 85 0 
Mechanical Reasoning i lL 3s o..&@-6 hi. 1 51 45 4 
Clerical Speed & Accuracy _— + 2 9 6 0 Se 68 29 83 
Spelling ll 15 0 & @&3 li 2 1 46 51 8 
Sentences 14 12 0 9 60 14 10 0 57 48 0 

Total 127 75 6 77 40 8 112 78 7 
Total Percentage 61 386 8 64 3838 8 58 388 4 61 386 8 
Grade 9—Percentage 61 36 3 
Grades 11-12—Percentage 62 36 2 





aG = Tg>Tz 
1 tz = Tq 


for grades 11-12. The data for the three 
criterion subject fields are shown at the 
foot of the columns. We shall come back 
to the differences among the predictors 
later. 

The first conclusions, then, are that girls’ 
grades seem to be more predictable from 
the Differential Aptitude Tests than boys’ 
grades and that this trend seems to be 
somewhat stronger in the Social Studies 
than in the Sciences. 

Another way of observing these sex dif- 
ferences is to orient our thinking in the 
direction of the tests, that is, the eight 
tests in the DAT battery. Table 2 presents 
this analysis in the rows of data. The num- 
bers of criterion groups showing each direc- 
tion of sex differences are sorted out by 
courses. At once a few interesting spots in 
the table become apparent. Under English, 
for example, the differences in favor of the 
women are quite pronounced except for 
Mechanical Reasoning, Spelling and Sen- 
tences; in the case of Spelling the general- 
ity expressed above is actually reversed. 
That the general trend does not seem to 
appear for these tests when English is the 
criterion course is an interesting fact. 

In the Social Studies area the trend fav- 
oring the women is clear all the way down 


Validity coefficient for girls greater than corresponding coefficient for boys. 
Validity coefficient for boys greater than corresponding coefficient for girls. 
No difference between validity coefficients for girls and boys. 


the column of tests. In the Math-Science 
category the same break from the trend 
as reported for English is observed. 

The actual differences between correla- 
tion coefficients for the two sexes, as seen 
in the original tabulations, ranged from 
.00 to .53. What we have done in Table 2 
is simply to report all the differences—al- 
though we know that small arithmetic dif- 
ferences may appear even when there is 
no “real” difference at all, or even when 
the “real” difference might be in the oppo- 
site direction. What happens if we consider 
only those differences that are statistically 
significant? 

The significance of each difference was 
evaluated by converting the 1’s to z’s and 
computing the corresponding critical ratios. 
The application of this procedure to the 
520 differences in the DAT sample is not 
impervious to criticism, because the various 
groups of coefficients are not independent 
of each other. The method may be consid- 
ered an ad hoc approximation rather than 
a precise test in this situation. 

In Table 3 are reported the number of 
differences which are statistically signifi- 
cant at the 10 per cent level or less. Thir- 
teen per cent of the observed differences 
are significant. In preparing the table we 
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Table 3 


Significant Differences (10 Per Cent Level) between 
Validity Coefficients of Boys and Girls by Subject Area 






































DAT Sample 
Significant Number of 
Number of Differences Significant Diff. 
Subject Comparisons =§ N Percentage fo>ta . . fa>fo 

English 208 24 12 18 6 
Social Studies 120 20 17 18 7 
Math-Science 192 25 18 18 7 
Total 520 69 13 49 20 

(71%) (29%) 

Table 4 
Direction of Differences between Corresponding 
Validity Coefficients of Men and Women in College 
Samples Tested with College Qualification Tests 

Significant 
Number of Differences Differences* 

Test twmt™  ™>Tw ty="w twot™ >Tw 
CQT Verbal 14 8 0 6 0 
Numerical 6 9 2 2 s 
Information Total 14 2 1 i 1 
Science® 8 5 2 8 1 
Social Studies® 12 8 0 (4 1 
Total Score 14 2 1 6 1 
Total 68 24 6 29 6 
Percentage 69 25 6 83 17 





aJuola did not present subscore data. 
*At 10 per cent level or less. 


computed the percentage of differences 
significant at the 1 per cent and 5 per cent 
levels; the values were 4 and 9 per cent, 
respectively. In the bottom line you will 
note that 71 per cent of the differences, 
significant at the 10 per cent level, favored 
the women, while 29 per cent favored the 
men. You will see that there were rela- 
tively more significant differences in the 
Social Studies than in English, with the 
Math-Science percentage in between. 
Results: College 

Let us turn now to a discussion of the 
college samples. In Table 4 we report the 
number of sex differences in validity co- 
efficients, for the six variables of the Col- 
lege Qualification Tests, which favor each 
sex. In all, 69 per cent of the differences 
in r favor the women and 25 per cent the 


men. In the right-hand columns, the num- 
ber of statistically significant differences 
are noted. Eighty-three per cent of the 
significant differences observed were in 
favor of women, and 17 per cent were in 
favor of the men. The 35 observed signifi- 
cant differences out of 98 possibilities repre- 
sent 37 per cent, considerably in excess 
of the 10 per cent expected to be signifi- 
cant by chance. 


In Table 5 I have summarized the data 
from the Juola (1960) and the University 
of Minnesota reports (Berdie, Layton, & 
Swanson, 1954) in the first columns and 
have quoted from the Berdie, Dressel and 
Kelso (1951) report in the last two columns. 
Among the 35 and the 18 comparisons the 
phenomenon we have been talking about 
is obvious. Out of the 35 instances, 9 were 
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Table 5 


Direction of Differences between Validity Coefficients of 
Men and Women in College Samples for Tests Other than CQT 








Juola and Berdie, et al. 


Berdie, Dressel & Kelso 


























Significant Significant 
Differences* Differences** 
N Percentage N Percentage N Percentage N Percentage 
tw>ty 26 74 9 100 12 67 6 86 
ty>tw 7 20 0 0 4 22 1 14 
fy = fw 3 6 0 0 2 1l 
Total 85 100 9 100 18 100 7 100 
*Significant at 10 per cent level, 
**Significant at 5 per cent level. 
Table 6 
Recapitulation from Tables 2—5 
High Schools Colleges 
DAT Data CQT Data Other Data 
All Comparisons 
rs favoring Women 61% 69% 74% 67% 
r’s favoring Men 86 25 20 22 
r’s the same 8 6 6 1l 
Significant Differences 
at 10 Per Cent Level 
rs favoring Women 71 83 100 86 
rs favoring Men 29 17 0 14 





statistically significant at the 10 per cent 
level, and all of these were in favor of the 
women. Of the 18 comparisons, 7 were sig- 
nificant at the 10 per cent level, and all 
but one difference favored the women. 

From this psycho-ecological excursion 
into the college meadows of our coefficient- 
filled countryside, we can now say that 
the evidence supports our hypothesis that 
aptitude tests predict women’s academic 
grades better than men’s. 


More Questions Than Explanations 
Many questions will come to your mind 
as you look at the data. Posing several 
questions is easier than finding satisfactory 
answers to them. 


Is the Trend Probably Greater in College? 

Is the trend for women’s grades to be 
better predicted than men’s grades equally 
prominent in high school and in college? 

The observations we have made indi- 
cate that the trend is more pronounced at 
the college level than at the secondary 


school level. The basic data in Table 2 
and in Tables 4 and 5, now recapitulated 
in Table 6, show that in terms of the 
total count of instances and in terms of the 
instances showing statistically significant 
differences, the phenomenon is more prom- 
inent at the college level. 


However interesting this conclusion may 
be, it is tempered by the need for more 
comparable data at the two educational 
levels. At the high school level, the pre- 
dictors are the eight DAT component 
scores and the criterion grades are in 
separate school subjects. At the college 
level, the predictors are various tests ap- 
propriate for freshmen, and the criterion 
grades are either grade-point averages for 
a term or, in a few cases, grades in fresh- 
man comprehensive courses. In Table 3, 
we noted that percentages of r’s favoring 
women were about the same in grade 9 
and grades 11-12. This information suggests 
the need for similar studies involving grade- 
point averages as the criteria for secondary 





266 Harold G. 


school samples and separate course grades 
as the criteria for college samples. It is 
unlikely, of course, that anyone will ever 
have the same predictor tests for grade 9 
and for college freshmen, although the 
psychological abilities being tapped might 
be similar, such as verbal ability. 

Based on the evidence presented here 
and that cited from other sources, my esti- 
mate is that the trend for correlations be- 
tween aptitude test scores and grades to 
favor women is more pronounced in col- 
lege than in secondary schools, but why 
this is so I have no clues. 

Are Higher r’s Due to Size of SD’s? 

Might the observed higher coefficients of 
validity for women arise from greater vari- 
ability of predictor scores and criterion 
scores among women? 

If the standard deviations of the women’s 
aptitude test scores and of their grades 
were generally larger, we might have a 
simple explanation of the trend we are 
talking about, since the size of a coefficient 
of validity is related to the size of the 
standard deviations of the variables being 
correlated. In Table 7 data are presented 
for some of the college samples for which 
standard deviations were reported. 

In Part A of Table 7, we see that where- 
as the trend is for the 1’s to be generally 
greater for women, 81 to 30, the standard 
deviations for the predictor tests (CQT 
parts and total) tend to be larger for the 
men, 89 to 23. In Part B, we see a similar 


Seashore 


situation when the standard deviations of 
the grades for 90 criterion classes are tal- 
lied. The r’s favor the women, 62 to 23, 
whereas the standard deviations of course 
grades are the same in 48 instances, and 
for the remaining 42 cases the SD’s tend to 
be larger for the men, 30 to 12. 


Clearly the phenomenon we are talking 
about cannot be dismissed by assuming 
that test and criterion scores for females 
are more variable. Women’s test scores and 
grades are less variable than men’s. In 
spite of this smaller dispersion in the vari- 
ables being correlated, the r’s for women 
are higher. 


Does the Trend Appear in Many Schools? 


One might also wonder whether there was 
any tendency for the significant differences 
in coefficients of validity to appear in a 
limited number of schools or classes. Could 
our significant differences, for example, 
originate in one or two of these high schools 
and colleges? In preparing Table 3, we did 
observe that of the 20 cases in which the 
difference in validity coefficients favoring 
the men-was significant, 12 were from one 
class in one school for whom grades in four 
criterion courses were available. The other 
six instances were in three other schools. 
While this is a small fact, it gives a clue 
to the possibility that schools themselves 
may be sex-biased with respect to the 
phenomenon we are discussing. On the 
other hand, the 49 cases in which the 
validity coefficients significantly favored 


Table 7 


Direction of Difference between 7’s in Relation to Direction of Difference between 
SD’s of Predictor Test Scores and Criterion Grades. College Samples 




















A. Predictors B. Grades 
Differences Differences in SD’s Differences in SD’s 
in 1's None M>W W>M Total None M>W W>M Total 
W>M 4 58 19 81 86 15 1l 62 
M>W 0 27 8 80 8 14 1 23 
None 0 4 1 5 4 1 0 5 
Total 4 89 23 116 48 80 12 90 





Note—SD’s were available for Part A in the CQT Manual, Minnesota Study, and the Juola 
articles; for Part B in the CQT Manual only. 
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Table 8 


The Relationship between DAT Subtests and the Direction of Difference between 
Validity Coefficients for Boys and for Girls 








A. Two Clusters of Tests Showing Different Trends 














Direction of VR, NA, AR MR, Spell. 
Differences SR, CSA Sent. Total 

N Percentage N Percentage N Percentage 
W>M 216 67 100 51 316 61 
M>W 98 80 90 46 188 86 
No Diff. ll 8 5 8 16 8 
Total 825 195 520 
B. Number of Significant Differences by Test 
Direction of 
Differences VR NA AR SR MR CSA Sent. Spell. Total 
W>M 6 5 4 2 4 9 1 ee 49 
M>W 8 0 6 4 1 1 2 8 20 
Total 9 5 10 6. . GF. 16 e 2b 69 





the women were scattered over 30 criterion 
classes in 10 out of the 14 schools. 

In the CQT data for colleges, 11 of the 
15 institutions produced one or more sig- 
nificant differences. Four of the 5 colleges 
which yielded 4 or more significant differ- 
ences favored the women and one of the 
men. 

Nevertheless it is worthwhile tossing into 
the hopper of unfinished business the ques- 
tion why some high schools and some col- 
leges show a trend not in accord with that 
which we have observed to be quite gen- 


eral. 
Is Trend Greater for Some Tests? 


Is there any evidence that the women- 
favoring 1’s are related to certain predictor 
testsP In Table 2 we noted that while the 
trend favoring women was general across 
the whole DAT battery, three tests seem 
to buck the trend. We have put this evi- 
dence in summary form in Table 8. 

In Part A, note that if we make two 
clusters of the tests, the trend favoring the 
women is clear for one cluster, whereas 
in the cluster composed of Mechanical 
Reasoning, Spelling, and Sentences, the 
trend is very slight. Why this should be 
I do not understand. To elucidate the situa- 


tion further I prepared Part B, which 
shows that among significant differences, 
the tendency toward equality of prediction 
for the two sexes from the Mechanical 
Reasoning, Spelling, and Sentences tests 
disappears. 

I do not believe I have enough data 
for adequate statistical control of variables, 
but I do want to pose an intriguing ques- 
tion: Is it possible that if we want to in- 
crease the efficiency of predicting the 
grades of men and women who earn grades 
in similar courses of study, we should seek 
to measure different predictive abilities for 
men and for women? I cannot probe this 
problem with the college data since it is 
apparent to all that the criterion of grade- 
point average is determined by quite dif- 
ferent patterns of course choices for men 
and for women in the freshman years. 

Is There Any Practical Significance? 

Are the differences which we have ob- 
served of any practical importance? This, 
of course, is a question of judgment. My 
purpose in presenting the data has been to 
call attention to what appears to be a 
clearcut trend, but I shall have to leave 
it to others to determine whether or not 
these findings make any difference in their 
thinking and whether one should be con- 
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Table 9 


The Distribution of Observed Differences in Validity Coefficients, in Terms of z, 
Without Reference to Direction of Differences 




















Size of Differences Nonsignificant Significant 
between 1’s Differences Differences 
N Cum. Percentage N Cum. Percentage 
.30 or More 43 100 
.20-.29 47 100 19 88 
.15-.19 78 90 7 10 
-10-.14 95 78 0 0 
.05-.09 117 52 0 0 
.00-.04 119 26 0 0 
Total 451 69 





cerned with such matters as these when 
undertaking validity studies in one’s own 
institution. 

In the earlier tables we summarized the 
observed differences so compactly that 
some of you may wonder how big these 
observed differences really were. Table 9 
presents this information for the DAT high 
school data. In the first columns there is 
a distribution of the differences, in terms 
of z, which are not statistically significant. 
At the right, the differences which are sta- 
tistically significant at the 10 per cent 
level have been presented. I have inserted 
cumulative frequencies so that you can 
get some notion of the percentage fre- 
quency of differences of the various sizes 
reported. Remember that the significance 
of a difference depends in part upon the 
size of the sample. Some of the nonsignifi- 
cant differences on the order of .20 to .29 
arise from smaller samples, while some of 
the significant differences of .15 to .19 
come from larger samples. In general our 
samples were of the order of 100 to 500 
cases in a criterion group, counting both 
sexes. Most of the samples included fewer 
than 200. 

At the moment I think the most import- 
ant practical implication of these data is 
at the computing level. I believe it is wise 
for institutions to compute separate valid- 
ity coefficients for men and for women 
even when the men and the women come 
from the same institutional pool of students 
and take quite similar programs of study 


within the secondary school or college. Cer- 
tainly it seems unjustified to compute valid- 
ity coefficients for sexes combined in col- 
lege populations when men and women 
are known to. undertake quite different 
programs of study. Although we don’t 
know why the sex-bias of validity coef- 
ficients occurs, it seems reasonable that 
probing for meaning will require separate 
reporting of r’s for men and for women. 
The Final Qestion: Why? 

Why should women’s grades be more 
predictable than men’s grades? Circular 
arguments are easy: the trend is so be- 
cause women tend to perform in academic 
courses more consistently in relation to 
whatever it is that aptitude tests measure. 

But why? The answer should be sought 
among the variables which regularly oper- 
ate to make the correlation between pre- 
dictors and criteria less than perfect. Valid- 
ity coefficients are less than perfect because 
of measurement errors, of course, but also 
because of a variety of other physiological 
and psychological variables, the latter 
usually subsumed under the general term 
motivation. Some prefer a more compre- 
hensive term such as nonintellective factors. 

Suppose we observed in the scattergrams 
for the two sexes the presence of more 
men’s tallies lying well away from the re- 
gression line which defines the value of 
r. Maybe men in general are as predictable 
as women in general, but at the same time 
in every male sample a few maverick per- 
formers exist whose atypical behavior low- 
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ers the coefficient. Maybe we will find 
that more men than women are “way out” 
in the scattergram because they are also 
“way out” in campus behavior, in and out 
of classes. A search of a considerable num- 
ber of actual pairs of scattergrams for men 
and women for the presence of such a 
small number of r-depressors might be 
fruitful. 

School and college counselors have com- 
mented to me at various times that more 
boys than girls tend to be underachievers, 
but I have not reduced this idea to data 
and to tables. Nor have I reviewed the 
literature on the point. If this notion is so, 
the lower r could be traced in part to 
greater instability of boys in academic set- 
tings. Such a finding would not answer the 
question of why, but we would be on a 
trail which might lead to an analysis of sex 
differences in motivation to achieve—at 
least to achieve in standard courses of 
study in standard school settings. 

This leads me to another bit of psycho- 
logical folklore which, if well demonstrated, 
would relate to the lower coefficients of 
validity for men. We are told that women 
in school and college are more conforming, 
are less likely to express themselves crea- 
tively in academic areas, are less likely 
to launch out on intellectual pursuits which 
are not part of their grade-giving courses. 
Men are alleged to be more productively 
creative in our society—and also to be 
more often in conflict with the accepted 
rules of behavior. Is this trueP—let others 
tell us. If it is true, why? It may be that 
among men total intellectual performance 
is rather closely related to ability, but that 
more men than women in schools and on 
college campuses address their abilities to 
activities — intellectual and otherwise — 
which are not directly reflected in grades. 
If a college man pursues a variety of in- 
tellectual and mentally demanding tasks 
outside of classes such as editing a news: 
paper, operating in campus politics, carry- 
ing a job on the side or building a reputa- 
tion as a playboy, his grades may be af- 
fected in somewhat unpredicted ways. In 
this case the r between aptitude test scores 


and achievement in courses would tend to 
be lower. 


It may also be that the explanation of 
the trend in terms of sex differences in mo- 
tivation will not be the same in the second- 
ary schools and in the colleges. Motivation 
patterns probably are different for mid-ado- 
lescents in secondary schools and for young 
adults in college. And, we do not know 
whether the observed trend remains 
throughout college since our available data 
do not go beyond the freshman year. How- 
ever, the trend does exist both early and 
late in high school. 


In speculating about causes, let me toss 
in another idea. Do teachers know how to 
grade women more objectively than men? 
This is not the problem of whether teachers 
favor men or women. Rather, the point is 
whether or not teachers grade women more 
rigorously for academic performance. per 
se. Do more extraneous r-reducing variables 
enter the teachers’ judgments in giving 
grades to men? One way to get at this 
problem is to see whether the trend we 
have noted persists when objective achieve- 
ment test scores are the criteria. 


Conclusion 


This study has been a psycho-ecological 
excursion into the swamps and woodlands 
of validity coefficients. We have gathered 
some specimens and we have sorted them 
out in certain columns and rows. We have 
noted that before we can make complete 
ecological deductions we need to search 
systematically for many more samples of 
paired coefficients of validity as well as 
some very specific instances to complete a 
satisfactory design. 


Now for a few minutes we have been 
sitting on the stump at the edge of our 
field smoking our pipes speculatively in 
search of reasons why women’s grades can 
be more predictable than men’s. Our pipes 
have been filled with a well-known blend 
called “Extrapolator’s Delight.” Perhaps 
these data will generate collection of more 
data to complete the description and verify 
what we have found. 
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Readers who are interested in the coun- 
seling of young people may use these data 
to pose some hypotheses about the dif- 
ferential motivations and patterns of adoles- 
cent and young adult behavior which might 
help explain the situation. Maybe some 
student will even be able to tell us some- 
time whether we should try to erase the 
observed sex differences or to take advant- 
age of them. Maybe someone will even 
conclude that the lower 1r’s for men are 
evidence of less grade-minded conformity, 
that the more erratic, less predictable grade- 
getting behavior of men may reflect a 
healthy free spirit as often as undesirable 
conduct. 

We started out with two hypotheses. The 
second of these was that the writer would 
be able to tell you what causes the trend 
here documented. That hypothesis we have 
had to reject. However, the first hypothesis 
stands: Academic grades of women in high 
school and college are better predicted 
from aptitude tests than are academic 
grades of men. 


Received September 21, 1961. 
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The writer will attempt to describe cur- 
rent investigations by himself and others 
in the field probably best described as 
psychotherapy” based on principles of hu- 
man learning. Several recent reviews (Ban- 
dura, 1961; Eysenck, 1960; Krasner, 1958, 
1961; Salzinger, 1959; Wolpe, 1958) de- 
scribe much of the relevant substantive re- 
search of the past decade, and several other 
works furnish a great deal of the ethical- 
social background for this report (London, 
1961; Mowrer, 1958; Szasz, 1961). In addi- 
tion, other authors have offered suggestions 
about “treatment” deriving from procedures 
peripheral to psychotherapy but based on 
learning principles (Lindsley, 1954; Sulzer 
and Sulzer, 1961). A new volume (Bach- 
rach, 1962) does much to bring current 
research into the mainstream of clinical® 
psychological practice. 

An attempt to bring both current scien- 
tific knowledge about human behavior and 
concern with important ethical-social issues 
together has resulted, for me, in a somewhat 
different approach to psychotherapy than 
that which has generally been attempted in 


1] am indebted to the Graduate School of the 
University of Minnesota and to the National In- 
stitute of Mental Health for their generous support 
during the investigations described. Professor 
Henry Borow and Miss Ruth Lorber offered their 
wise criticisms of earlier drafts of this paper. 

2The term “psychotherapy” as used in this paper 
is intended to cover the broad spectrum of ac- 
tivities pursued by psychologists and others in 
their helping relationships with others and in- 
cludes counseling, psychoanalysis, guidance, etc. 
A “psychotherapist” is a professional person so 
engaged. 

3The term “clinical” as used in this paper is in- 
tended to refer to psychotherapy, its practice and 
its practitioners. 


the past. To begin with, certain assumptions 
are presented that appear relevant and 
necessary in this approach. 


1. Psychotherapy is a learning procedure and 
the psychotherapist is a teacher. 

2. As in other fields of teaching, the learning 
procedure involves two broad classes of concern, 
content and methodology. 

8. Most, if not all, complex human learning is 
apparently controlled by reinforcement. (While 
principles of contiguity and drive reduction may 
be discerned in most reported research, it would 
appear that a reinforcement schema remains most 
manipulatable, predictable, and parsimonious.) 

4. Unless clearly explicated otherwise, the 
therapist is the agent of the patient and under- 
takes to teach only what is specifically determined 
jointly by the patient and therapist. 

5. There is a period of interaction between 
therapist and patient before therapy, per se, takes 
place that is oriented toward establishing the 
psychotherapeutic contract between them. The 
contract is always modifiable by joint agreement 
and is as explicit as possible so as to prevent 
future misunderstanding and to state clearly the 
nature of the dyadic relationship and what other 
relationships may be necessary. (The problems of 
establishing a contract with a minor are some- 
what more complex than dealing with an adult 
and will not be discussed in this paper.) 

§. Maximum honesty on the part of the thera- 
pist is essential. He must not allege one thing and 
do the contrary. If he has neither the content 
or method mastery necessary to achieve the goals 
stated in the contract or in the pretherapy contract- 
determining period, he should report this to the 
patient. If for ethical or moral reasons, he cannot 
fully endorse the goals sought, this too should be 
explicated, and if necessary, referral made to an- 
other more appropriately-chosen therapist. 

7. The methodology to be employed in therapy 
may be explicated although it is not always 


4The term “patient,” despite its unfortunate 


connotations, is used to refer to all those seeking 
assistance from a psychotherapist. 
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necessary to do so. However, the explication of 
content is mandatory. 


8. Absolute confidentiality of the relationship 
exists unless stipulated otherwise in the contract. 
(This pertains to professional and scientific as- 
sociates as well as to school authorities, employers 
relatives, etc.) Only the most disguised data may 
be presented to others and then only when it serves 
the purpose of educating others or advancing the 
state of knowledge. 

The above principles have been de- 
veloped to handle many of the problems 
associated with the practice of psycho- 
therapy. They are neither complete nor 
necessarily final but do appear at my cur- 
rent level of investigation to be most rele- 
vant. As in the selection of the learning 
schema (reinforcement) to be employed, 
they are largely developed pragmatically. 
If they should prove less useful than an 
alternative, they should be changed or elim- 
inated. 

As may be inferred from above, the as- 
sessment of “successful” psychotherapy must 
be looked at in a different way than has 
been typical in the past. Fulfillment of the 
psychotherapeutic contract is the sole cri- 
terion of success, and since each contract is 
unique, success may be determined only 
by study of the individual case. 

For research purposes, specific classes of 
behavior might be examined so as to study 
the effectiveness of a particular teaching 
method but caution should be employed 
Individual differences often prevent this 
kind of endeavor from being successfully 
undertaken. Ayllon and Haughton (1962), 
however, have demonstrated that it can 
be done in some situations. With a group) 
of hospitalized chronic psychiatric patients) 
having eating problems, they were able to 
demonstrate the efficacy of one general 
technique applied to a full ward. Wolpe 
(1961) has also reported on a class of be- 
haviors treated by reciprocal inhibition pro- 
cedures. 

A profoundly important task for the psy- 
chotherapist during both the pretherapeutic 
and therapy parts of the interaction is the 
assessment of the patient. The assessment 
may include such variables as the class of 
reinforcers appropriate to the task for the 
particular individual, the appropriateness 
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of the desired end goal behaviors, and the 
consequences both to the individual and 
to others close to him of learning the new 
behaviors. It appears that individual differ- 
ences are so great that what may be a sig- 
nificant reinforcing stimulus for one person 
is of negligible reinforcing value to another 
person. Also, characteristics of the person 
(intellectual, motor, social class, vocational, 
etc.) may render a particular goal behavior 
difficult to learn or perhaps even impos- 
sible. The recognition of this and its com- 
munication to the patient is necessary. 

I have so far not discriminated among 
the classes of behavior usually discussed in 
the behaviorist literature. The reason is that 
it would appear that the various subdivision 
of operant behavior, verbal and nonverbal, 
may be manipulated in substantially the 
same way. Respondent behavior, which 
would include, perhaps, private experiences 
of emotion, may be manipulated by the 
same techniques that are used in operant 
learning if one is able to communicate what 
the emotion is. I have found that the report 
of a patient describing an “internal” set of 
reactions (anxiety, guilt, fear, delight, 
thirst) tend to be uniquely characteristic of 
that particular person and situation and that 
unpleasant personal sensations (emotions ) 
may be treated by teaching the patient al- 
ternative verbal and motor responses in the 
situations that give rise to the unpleasant 
feelings. 

Another feature that is of great import- 
ance to doing therapy within a reinforce- 
ment context is that of the therapist’s be- 
havior over and beyond his intentional 
teaching acts. For example, on several oc- 
casions it has been noted that the frequency 
of a particular action by a patient has risen 
substantially over a period of time. Sub- 
sequent analysis of the patient-therapist in- 
teraction has suggested that a behavior of 
the therapist has appeared to be reinforc- 
ing or cue-producing to that particular 
subject and that it would have proven quite 
difficult to predict the phenomenon in ad- 
vance. An interesting example may be cited. 
I smoke cigarettes and will light up a new 
cigarette twice during a typical therapeutic 
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hour. A patient had been ruminating about 
her relations with her father who had re- 
cently died and would occasionally inter- 
rupt these unpleasant ruminations with the 
recall of a pleasant past experience with one 
of her parents. Subsequent analysis of sev- 


‘eral sessions demonstrated that each inter- 


ruption in the unpleasant ruminations was 
preceded by the lighting of a cigarette by 
me. In the next therapeutic hour, I planned 
and executed the lighting of a cigarette at 
certain intervals. Each instance was fol- 
lowed by a pleasant recall, even to the 
interruption of the telling of an important 
recent experience. Additional exploration 
of the phenomenon yielded little significant 
information although no similar relationship 
existed between the lighting of a cigarette 
by anyone else in any known situation and 
any specific response in the patient. 

The above simple example can also be 
used to illustrate other aspects of therapy. 
One of the goals in therapy was the diminu- 
tion in intensity and frequency of the de- 
scribed ruminations and consequent feel- 
ings of guilt. One method employed was 
allowing the patient to describe and report 
these experiences at length whenever she 
so wished. At no time, however, would 
the therapist respond by any actions known 
to reinforce this behavior. This was in sharp 
contrast to the patient’s experience with 
another therapist who had responded by 
intensive exploration of the patient's early 
life and relationship with her parents. I 
never raised a question regarding these is- 
sues, did not respond with behavior in- 
dicating approval of the retelling, and also 
never suggested inhibiting the reporting of 
her history and feelings. Massive indiffer- 
ence might best describe my behavior. 
Within a very few sessions, such rumina- 
tions, or at least the verbal expression, were 
diminished to a negligible level. 

Towards the end of therapy, the above 
patient was asked about the almost total 
absence of her previous concern with her 
father and how she thought it had come 
about. With an interesting mixture of dis- 
cernment and naiveté, she reported that 
since the therapist did not appear to be 


very interested in that feature of her life, 
she too gradually lost interest in the sub- 
ject and began to feel that it was not really 
very important after all. 

As has been pointed out by other writers 
in the field (Ayllon, 1960; Ferster, 1958), 
psychotherapists and social agencies often 
report that they are doing their best to 
diminish a particular behavior in favor of 
another but that a close analysis of the 
situation suggests that they are acting in 
a fashion so as to maintain the undesirable 
behavior of the patient. I would propose 
that the above patient’s previous shoes 
had been so engaged. By exploration, com- 
ments, questions, and concern, he had re- 
inforced the patient’s preoccupation with 
an uncomfortable subject matter. 

Various clinicians have reported that it 
often seems that therapists of a particular 
orientation tend to get patients that some- 


chow seem to fit the theoretical bias of the 


therapist. I would suggest a modification 
and extension of this hypothesis. It seems 
reasonable that a therapist is likely to rein- 
force the behaviors in therapy that are con- 
sonant with his theoretical expectations. 
After awhile, the patient does appear to 
be a “classic” case of something or another. 
London (1961) warns of this indirectly by 
pointing out how much care should be ex- 
ercised by the therapist so as not to teach 
the patient his own particular moral, ethical, 
or social value system. I would add’ an 
“amen” to this with the reservation that it 
is still perfectly reasonable for a therapeutic 
contract to include a provision regarding 
the learning of a particular theoretical, so- 
cial, moral, ethical, or theological point of 
view. I would suspect that such agreements 
may be implicit in current practice when 
a sophisticated patient selects a therapist 
out of a group of practitioners of different 
orientations. He may wish, for example, 
to learn an orthodox Freudian interpreta- 


tion of his own behavior and therefore 
select the appropriate analyst. This is prob- 
ably, however, a rather uncommon happen- 
ing as therapists do not “advertise” their 
orientation to the general public and some 
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considerable investigation by the patient 
would be necessary to ascertain correctly 
the nature of various therapies and thera- 
pists. 

The example of the woman with the un- 
happy ruminations might also be used to 
illustrate the nature of extinguishing both 
an operant verbal response and an accom- 
panying response of unhappiness and guilt. 
In this instance, as in the overwhelming 
preponderance of such cases seen by the 
author, specific operants accompany or pre- 
cede an emotional response. The verbal 
operant need not be only descriptive of the 
emotional state but have as its subject mat- 
ter another concern. In well over the major- 
ity of such cases, reduction or extinction 
of the operant is accompanied by a reduc- 
tion in the intensity or frequency of the 
emotion. I believe, at the moment, that 
such a phenomenon is a variant of an 
S-r-s-R paradigm discussed by Hefferline 
(1962). 

More direct manipulation of subjective 
emotional responses is also feasible. Tension 
and anxiety may be treated via associating 
pleasant responses gradually with stimuli 
previously associated with unpleasant re- 
actions. The efficacy of such methodology 
is somewhat variable and often more than 
one procedure has to be undertaken before 
success is achieved. At least, such has been 
my experience in dealing with the patient 
whose environment is difficult to manipu- 
late. At times, it is almost necessary to in- 
volve individuals in the patient's life whose 
behaviors are important in shaping the 
patient’s behavior. When such a conting- 
ency arises, the therapist is obligated to dis- 
cuss this with the patient and pursue such 
a course only upon the patient’s approval. 

An example of introducing “pertinent 
others” into the therapeutic situation may 
be briefly described. A man whose vocation 
required frequent visits to taverns and bars 
had himself become a very heavy drinker 
of alcoholic beverages. Being drunk on the 
job and at home became a very serious 
problem and he sought help to stop his 
drinking altogether. Very early in therapy, 
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it became apparent that the patient. had 
found considerable social reinforcement in 
his drinking from his interactions with 
others in the typical tavern. However, two 
friends whose friendship and esteem he 


prized highly found his behavior when 


drinking so obnoxious that they avoided. 
him at such times. It was arranged to have 
the two friends accompany the patient to 
bars on several occasions but only when 
the patient restricted his intake to soft 
drinks. The interactions at such times 
proved so enjoyable and rewarding to the 
patient that he found the drinking of al- 
cohol rather superfluous. Subsequent inter- 
actions with bartenders, saloon keepers, and 
others when drinking soft beverages proved 
to have sufficient reinforcing value so that 
his alcoholic intake dropped very quickly 
to zero. 

As in the above example, intermittent 
social reinforcers have demonstrated an 
amazing degree of efficacy in controlling 
complex social -behaviors in patients. At 
times, it is not clear whether it is a specific 
operant that is being reinforced which leads 
to subsequent new learning of other oper- 
ants or whether a variety of different oper- 
ants are being reinforced by the same or 
similar social interactions. In either case, 
the procedure is frequently very effective. 


The writer believes that his own most 
important contribution is the application of 
principles of learning to doing psychother- 
apy with the population generally served 
by clinicians in their everyday out-patient 
practice. I have not attempted to deal with 
a particular group such as chronic psychia- 
tric in-patients or with a particular class of 
deviant behaviors such as phobias. Rather, 
it has seemed important to me to attempt 
to apply what knowledge we have to those 
people and problems which come in a some- 
what haphazard way to the attention of the 
therapist serving the general population. 
For this reason, and because of the nature 
of the problem of determining “success,” 
reports of the efficacy of this kind of ther- 
apy are difficult to frame in the fashion 
typically reported in the research literature. 
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For reasons cited earlier in this paper, I 
feel it appropriate to measure success by 
matching the goals stated in the psycho- 
therapeutic contract with the final result 
of therapy. Complete success would be 
total agreement between goals and achieve- 
ments. Less than total success would be dif- 
ficult to state in a fashion adequately re- 
flective of what actually occurred. For 
example, let us take a case where five broad 
classes of behavior are specified in the 
contract and only four classes have been 
apparently well learned. The fifth class in- 
cludes a variety of specific operants only 
some of which have been learned. One 
might say that the therapy was eighty-plus 
per cent successful. I am not sure, however. 
that such a statement is adequate. For ex- 
ample, it may be that the fifth class of be- 
haviors was so important to the patient in 
comparison to the other four, that the 
patient would feel that therapy had been 
largely unsuccessful. An outside observer 
might evaluate the behaviors differently, as 
might the therapist. While it seems appro- 
priate to evaluate the success in an in- 
dividual case by the patient’s own report, 
such a communication in the research litera- 
ture may not be acceptable. 

Investigators legitimately demand re- 
sults permitting replication and extension. 
At this time, very little can be offered that 
would suffice. The therapist’s evaluation 
of his success is not acceptable evidence. 
Individual psychological test results are 
largely irrelevant as, in most therapy cases, 
the goals of the therapeutic contract are not 
typically measured by our instruments. Be- 
havior rating scales would be appropriate 
only if the scales measured the behaviors 
stipulated in the contract but this rarely 
happens. 

I will offer only a very general and tenta- 
tive statement of results, recognizing both 
the small number of cases so far studied 
and the difficulty in assessment. By taking 
the number of specific behaviors stipulated 
in a contract and any class of behaviors 
stipulated, one arrives at a total number. 
This number does not take into account 
the relative importance of such behaviors 


nor does it take into account any evidence 
of future continuation of the behavior. On 
this basis, I feel that the most honest state- 
ment of results would indicate that be- 
tween eighty and ninety per cent of all 
goals have been achieved. The range, 
rather than a specific figure, is presented 
because in my own evaluation of contract 
fulfillment, questions about adequate learn- 
ing of some responses remain. 


No “follow-up” data are presented as I 
have serious questions about the appropri- 
ateness of such reports within the context 
of the kind of therapy described here. 


In summary, I have tried to present a 
brief account of a kind of psychotherapy 
that appears to hold promise. That it is 
highly tentative in its application and suc- 
cess should be apparent. That it is very de- 
manding of the therapist should be equally 
apparent. Further investigations will be re- 
ported and, I hope, replicated. 
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Comments and Letters 


The 1962 APGA Convention: 
An Example of Coalition Behavior 


The American Personnel and Guidance Associa- 
tion represents an organizational phenomenon of- 
fering a dual appeal to psychologists. Its mission 
and objectives appeal particularly to counseling 
psychologists, many of whom are members; and 
in view of its rapid growth and corporate behavior 
it is worthy of study by psychologists who are 
interested in organization theory. This writer has 
elsewhere supported the argument that the APGA 
is not, and cannot become, the corporate body of 
a unified profession in the true sense (McCully, 
1962 (a) & (b)). Its composition and its mission 
as an organization can best be interpreted in terms 
of coalition theory (Cyert & March, 1959; Pepin- 
sky). The recent annual convention of APGA in 
Chicago can be viewed as an example of the coali- 
tion behavior that is described by Pepinsky: “Per- 
sons in the coalition negotiate agreements to per- 
form interdependently tasks that establish and 
maintain the coalition in an environment.” The 
report which follows subtly reflects such behavior 
although its primary purpose is to report the 
fertile impact the coalition is making upon per- 
sonnel and guidance work. 


More than five thousand persons attended the 
convention. This represented 32 per cent of the 
membership. But the most significant aspect of 
the 1962 convention was not the number in at- 
tendance. Rather it was the quality of what 
transpired and the implacable thrust of fertile 
ideas toward promising horizons. The convention 
could be likened to the premiere of a modern 
symphony. It was dominated by a great contrapun- 
tal consisting of three themes in counterpoint, inter- 
spersed with periodic accents and flourishes. 


The major motif was sounded in the overture by 
Harold Taylor in his keynote address. The back- 
ground for this motif was the human predicament 
in contemporary society characterized by Taylor 
as public relations oriented, webbed with bureauc- 
racy, and filled with the sound and fury of mass 
communications. This, said Taylor, is accompanied 
by a pervasive ethic among too many college stu- 
dents which polarizes aspiration around obtaining 
steady employment with a large corporation, own- 
ing a home in the suburbs, having two cars, three 
children and a wife who says “yes Joe, yes Joe.” 
The motif was that of man returning to himself, 
man recapturing his identity, again becoming an 
individual with meaning and purpose in the face 


of mass pressures toward conformity and ennui. 
In brief the motif was that of individual freedom 
and responsibility with emphasis upon the capacity 
to innovate and to cope with risk rather than 
merely to adjust. 

The three themes in counterpoint were these: 


1. A series of six symposia devoted to second- 
ary school counselor education standards. At each 
of these a position paper was presented by a prom- 
inent counselor educator. The subjects of the 
position papers were: “Philosophy and Objectives 
of Counselor Education,” “Curriculum for Coun- 
selor Education,” “Practicum and Interneship,” 
“Selection and Placement of Students in Counselor 
Education Pograms,” “Research in Counselor Edu- 
cation Programs” and “Administrative Relation- 
ships and Services in Counselor Education Pro- 
grams.”! The presentation of these position pap- 
ers culminated the first two years of a five-year 
Cooperative Study of Secondary School Counselor 
Education Standards which was initiated and is 
being spear-headed by the Association for Coun- 
selor Education and Supervision. Although the 
author of each took responsibility for the contents 
of his paper, he did have the benefit of reactions 
and suggestions coming from more than 200 “grass 
roots” committees throughout the country which 
had been studying these same topics locally for 
about 18 months. That these position papers made 
a strong impact upon the large audience attending 
each symposium was abundantly evident. That 
they will continue to have impact upon the de- 
velopment of standards is equally evident. 

There is not, of course, universal agreement 
upon each position advocated. The divergencies 
of opinion expressed seemed to center chiefly 
about the (1) length of training; (2) the amount of 
foundational curiculum content to be drawn from 
the social and behavioral sciences, particularly 
psychology; and strangely enough, (3) whether 
persons other than certified and, experienced 
teachers should be permitted to enter secondary 
school counselor education. Perhaps the most valid 
criticism, of the position papers voiced was that 
they had been formulated in the absence of an 
explicit definition of the role and functions of the 


1Copies of these papers may he puchased at a 
nominal cost from APGA, 1605 New Hampshire 
Avenue, N.W., Washington 9, D. C. 
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secondary school counselor. These symposia, and 
the on-going study of counselor education stand- 
ards have no real precedent or counterpart in the 
personnel and guidance field. This represents in- 
novation. It constitutes a bold attack. on a crucial 
and difficult developmental task in professionaliz- 
ing the occupation of school counselor. 


2. A series of five scheduled meetings on Con- 
ceptual Foundations of Counseling. The first four 
of these each featured a major paper with two 
commentators, on the topics of “Psychoanalysis,” 
“Self-Theory,” “Existentialism,” and “Operant Con- 
ditioning.” The fifth of this series was devoted to 
syntheses and demonstrations, with a demonstrator 
for each of the four theories. This series on Con- 
ceptual Foundations of Counseling was also, in 
one sense, a “first” in APGA conventions. At no 
past convention has this amount and. quality of 
attention been devoted to the theoretical and 
philosophical foundations of counseling. 

8. The contributions of research in the be- 
havioral and social sciences to curriculum content 
in counselor education. This consisted of four 
scheduled sessions and a separately scheduled 
concluding symposium. Topics and speakers at 
the four sessions were: “A Tentative Holistic 
Taxonomy Applied to Education” by.W. H. Cow- 
ley; “An Anthropological View of Social System 
and. Learning” by Solon Kimball; “The Choice 
of Models: A Developmental Analysis of Conflict 
and Continuity in Human Behavior” by Jerome 
Kagan; and “Freedom and Responsibility Re- 
Examined” by Rollo May. The strong impact upon 
the large audience attending each session was self- 
evident. 

The contribution of this series was made pos- 
sible through a research project being sponsored 
by Teachers College, Columbia ‘University. The 
next step in the project will involve an invitational 
working conference which will include the four 
behavioral scientists who presented papers in the 
convention series, and a counselor educator and 
a behavioral scientist from each of five institu- 
tions of higher education selected on the basis 
of leadership and quality in their current counselor 
education programs. In a sense the project is two- 
pronged:. It aims to stimulate behavioral scientists 
to conduct research needed further to undergird 
personnel and guidance work; and it aims to 
arouse the interest of behavioral scientists in 
identifying those relevant aspects of subject matter 
and research in their own disciplines which can be 
included in the curriculum of counselor. education 
on a manageable and productive basis. 

A definite accent at the convention was provided 
by research reports. Judging by program titles 
only, there ‘were a total of 18 scheduled sessions 
devoted to reports of research. In the aggregate 
‘these consumed a net scheduled time of 39 clock 
‘hours and covered: a wide range of inquiry. In 
terms of the various titles there appeared to be 
evidence of moving beyond research of the survey 
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type to that invyolviig experimentation and the 
determination of relationships between and among 
selected variables. One major research report dealt 
with an ambitious inquiry into academic motiva- 
tion being conducted at Michigan State University 
under a Cooperative Research Contract. Another 
report of great interest stemmed from data col- 
lected in Project Talent which reveals certain 
characteristics of secondary school counselors as 
of the spring of 1960. This report seemed to con- 
firm some things feared and to highlight some 
acute needs with reference to the current status 
of the occupation of secondary school counselor. 
Among the shockers presented were these: (1) 
When school administrators reported the num- 
ber of counselors in their schools, extrapolation of 
that sample figure to the national total would 
represent the 30,000 high school counselors na- 
tionally that are frequently reported. But, when 
questionnaires were completed and returned by 
those same counselors who were devoting 20 per 
cent or more of their time to counseling and 
guidance, the estimate of the national high school 
counselor population dropped to between 18 and 
19 thousand. (2) With reference to training status, 
21 per cent had no graduate credit in counseling 
theory and techniques, 29 per cent no credit in 
analysis of the individual; 43 per cent no credit 
in educational and occupational information; 30 
per cent none in philosophy and principles of 
guidance; 37 per cent none in psychological foun- 
dations, 75 per cent none in sociological founda- 
tions; and 70 per cent none in practicum. (8) Only 
50 per cent of the counselors in large schools 
and 31 per cent in small schools were certified. 


One final accent will be noted. On Thursday 
morning, from 8:30 to 11:50 am., before an 
audience of almost one thousand, what will prob- 
ably be the last formal billing of the Wrenn Re- 
port (1962) at a national convention transpired. 
While this was a finale, it was far from a finis. 
The impact of this report unquestionably will be 
strong over the next several years. Three papers 
were presented on implications of the Wrenn Re- 
port: one by a secondary school counselor, one by 
a. counselor educator and one by a state super- 
visor. The papers presented by the counselor 
educator and the state supervisor reflected certain 
broad areas of agreement, but on a number of 
the more controversial points, they represented an 
interesting study in contrasts of attitudes and 
opinion. ~ 

The paper given by the school counselor de- 
serves special mention because it reported re- 
actions to the recommendations in the Wrenn Re- 
port of a national sample of members of ASCA 
obtained by a recent survey. Based upon the re- 
actions of that sample, school: counselors appear 
ready to accept change and ready to move ahead. 
For example, the counselors themselves accepted 
primary responsibility for the current confusion 
as to counselor role and function; they held that 
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a local school administration is justified in claim- 
ing a counseling ._program only when the school 
has a sufficient number of qualified counselors to 
meet the counseling needs of all of its students; 
they voiced the view that all counselors should 
have supervised counseling experience as a part 
of their formal preparation; they urged that from 
one-third to one-half of counselor education cur- 
riculum content be drawn from psychology, sociol- 
ogy and the other behavioral sciences; and they 
recommended opening the career channel to school 
counselors by allowing selected individuals to 
undertake suitable foundation work as under- 
graduates and.to proceed on through graduate 
preparation without prior teacher certification and 
teaching experience. 


The foregoing is not to be construed as a sum- 
mary of all that transpired at the convention. 
Rather, selected aspects are reported which mani- 
fested an unusual release of creativity, of freedom 
to think, to express ideas, and to face issues 
squarely. These transactions coincide with Cyert 
and March’s theory of the making of side pay- 
ments (in this case policy payments rather than 
monetary) in negotiating the preference ordering 


of the organizational objectives of the coalition 
(1959). Thus, the convention was a prologue to 
more rapid advancement to personnel and guid- 
ance work as a science and as a profession. 


C. Harold McCully 
U. S. Office of Education 
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Schmidt Is Wrong on Privileged Communication 


To the Editor: 


In an admittedly sketchy review of numerous 
legal concepts applied to counseling and clinical 
psychology (this Journal, 1962, 9, 35-44), Schmidt 
has committed a grevious error which may erron- 
eously lead psychologists to believe they possess 
some special immunity to actions for defamation. 
He implies in three places (pp. 38, 40, 41) that the 
privileged communication sections of certifica- 
tion and licensure statutes will protect psycholo- 
gists from liability for slander or libel. For ex- 
ample on p. 40 he states, “In summary, it ap- 
pears that in states with legislation for psycholo- 
gists which accords him privileged communication, 
such immunity will largely ensure him freedom 
from libel.and slander, if he carefully considers 
his ethical and legal responsibilities in handling 
case material. In states without legislation or court 
recognition the psychologist must remain particu- 
larly aware of the grounds for actions of libel 
and slander, and their relation to his activities.” 


None of the existing statutes affect the law of 
slander and libel in any way. The psychologist’s 
position with respect to tort liability is the same 
in states with “legislation for psychologists” as it 
is in those without. Dr. Schmidt has confused the 
term “qualified privilege” as used in tort law 
with the term “privileged communication” as used 
in the law of evidence. The former is a principle 
(developed by the courts without the aid of sta- 
tutes) which protects a defendant from liability if 


he made a defamatory statement in good faith and 
under justifiable circumstances. The law recog- 
nizes that it is sometimes socially desirable for 
information concerning people to be communi- 
cated to others. For example, it is socially desir- 
able for a student’s professors to furnish informa- 
tion to prospective employers. A defamatory state- 
ment made in good faith and under these circum- 
stances is said to be qualifiedly privileged. In other 
words qualified privilege is an expression which 
connotes only a substantive defense to a tort action. 
If a psychologist adheres to the APA ethical stand- 
ards (1953) in revealing information about his 
clients, he will probably meet the requirements 
of qualified privilege. For example, in a case 
which Dr. Schmidt did not mention (pp. 37, 39), a 
psychologist was found to have a qualified privilege 
to. reveal an IQ score to the psychiatrist with 
whom he worked (Iverson v. Frandsen). 


Privileged communication, as used in the law 
of evidence, is a right of clients of professional 
persons to prevent the professional person from 
revealing communications of the client in legal 
proceedings. It is this right, analogous to the right 
of attorneys’ and physicians’ clients, which the 
certification and licensure statutes create for the 
clients of psychologists. It cannot be emphasized 
too strongly that this is merely a right of a client 
to prevent a psychologist from testifying in legal 
proceedings. It accords no benefits or immunities 
to the psychologist. It is unfortunate that this 
misconception which appears to have begun with 
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Carter (1954), reappeared in Bakken (1961) and 
now in Schmidt’s article, has not been corrected 
before this. The passage of privileged communica- 
tion statutes should not lull psychologists into being 
any less careful with information about their clients 
or give any false sense of security in believing 
they have acquired any special rights. Other errors 
of fact and legal interpretation in the Schmidt 
article and similar articles should make the reader 
wary of relying upon them as adequate legal inter- 
pretations applying to any particular situation. 
On a matter of opinion, Dr. Schmidt optimisti- 
cally predicts that psychologists will get the right 
of privileged communication without legislation. 
I fear this is unjustified. Nearly all courts in the 
United States, all leading scholars of evidence 
(Wigmore, 1940; Morgan, 1948; McCormick, 1956), 
and the American Bar Association Committee on 
Evidence (1987) display a distinct antipathy to 
suppression of evidence in any form including 
extension of the right of privileged communication. 
Charles J. Krauskopf 
University of Missouri 
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A Reply to Crites’ Review of 
The Neuroticism Scale Questionnaire (The NSQ) 


The reviewer and I agree on NSQ publication 
date (1961), publisher, and his description of the 
test (Crites, 1961): “A brief (5 to 10 minutes) 40 
item inventory developed from an analysis of over 
4,000 items ... yields part scores on Tender-Mind- 
edness, Depression, Submissiveness, and Anxiety, 
as well as a total Neuroticism score. The sub- 
scales . . . are largely independent of each other 
. .. The rationale . . . is that ‘neurotics do not 
differ from normals on one dimension only . . . 
but on many personality dimensions at once 
(Manual, p. 4). The total NSQ score . . . reflects 
the over-all neurotio trend of ‘the statistically 
relatively rare person who happens to be high on 
all components at once’ (Manual, p. 4).”* 

Agreement ends as Crites continues: “The logic 
here seems strained, however, since the concept 
of neuroticism is either multi-dimensional or it is 
not.” Why? Microscopes reveal distinct parts 
where unaided eyes see singleness. At issue is the 
resolving power of the measuring instrument; 
strained vision, not strained logic. At a low level 
of “resolution,” linking with clinical lore from a 
test-less. past, NSQ total score simply specifies 
degree of neurosis. Increase “resolving power and 
the NSQ picks out four distinct components in 
neurosis. 

Logic aside, the reviewer claims a failure to 
demonstrate empirically that neuroticism is multi- 





*But the reviewer has the page wrong. It’s page 
6. 


dimensional, since the Anxiety Scale component 
of the test is (Crites, 1961) “The only scale which 
consistently differentiates the clinically diagnosed 
groups of neurotics, psychotics, homosexuals, al- 
coholics, drug addicts, and psychopaths. . . .” 
Now, the NSQ Manual (top, p. 12) states clearly 
and unequivocally the (rather obvious, anyhow) 
point that, primarily, a neurosis test must give 
different scores for neurotics vs. normals; not psy- 
chotics, homosexuals, etc. vs. normals. 

If the reviewer had grasped that this neurosis test 
is validated on neurotics, he would have seen im- 
mediately that, not just anxiety, but all four NSQ 
components tend to deviate significantly from 
normal over the neurotic groups (Manual, Table 
5); hence all four are needed to describe the 
typical neurotic. Neurosis is thereby presented as 
multidimensional. These are major, emphasized 
points in the Manual and background literature 
(Cattell & Scheier, 1961). 

Homogeneity reliability is +.67 for total NSQ 
score. The reviewer criticizes this as low, then 
cites one of the Manual’s answers to this criticism: 
that neuroticism is a heterogeneous thing (four 
distinct components), hence, cannot realistically 
be measured by completely homogeneous items. 
Here the reviewer argues that neuroticism is homo- 
geneous, but the above two paragraphs just con- 
sidered have refuted this argument, so the hetero- 
geneity-reducing-reliability point remains. 

The reviewer might have noted that the Manual 
(p. 11) describes a straightforward way to raise 
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reliability of .each NSQ component: add items 
from comparable scales in the longer 16 PF Test 
(Cattell & Stice, 1957). The reviewer is actually 
challenging this well known and accepted com- 
parability principle when he deplores “. . . in- 
ferences about the validity of the NSQ from data 
on scales with similar names in the 16 Personality 
Factor test which have different items!” "Why so 
shocked? In an internally consistent set of items 
measuring, say, anxiety, physical separation of the 
first and last 50 items doesn’t suddenly make them 
different from anxiety and from each other! Just 
so, certain groups of “different” 16 PF items 
(Cattell & Stice, 1957) compose “scales with simi- 
lar names,” not coincidentally, but because they 
actually are comparable forms to the NSQ sub- 
scales. 

Moving now from the test authors’ concepts to 
the reviewer’s, 25 per cent of the review con- 
siders the concepts of “mode,” “area,” and “gen- 
eral level” of adjustment. I’m thinking of offering 
a reward to anyone finding these concepts in the 
NSQ Manual or background references (Cattell & 
Scheier, 1961). I can’t. “Conceptual co-existence,” 
perhaps, but “conceptual aggression” (attempts to 
evaluate and criticize the NSQ in terms of the 
reviewer's concepts), no! Example: the NSQ “.. . 
focuses more upon level than mode or area. . .” 
and what some of its components “. . . measure 
with respect to modes of adjustment is unknown 
. . 2” It is “unknown,” mainly because the test 
authors exercised the right to conceptualize their 
data in their own way. True, an author can’t 
insist on being judged entirely within his own 
conceptual framework, but whoever imposes a 
radically different one should identify it as differ- 
ent, even attempt some “translation.” The review- 
er does neither. 

Three criticisms—Crites, 1961) “. . . complex 
scoring key, poorly described norm groups, and 
unfamiliar trait names . . ."—in 11 unelaborated 
words is exquisitely swift critique. 

The NSQ key is very simple, requiring only 
the ability to count and add 1’s and 2’s for marks 
showing up through a punched-hole key. Average, 
or nongenius scoring clerks—I’ve watched and 
timed them—need perhaps 2 or 3 minutes to 
understand instructions, and a minute or so per 
case after that, for total score. I can’t find in the 
publisher’s files any previous “complexity” com- 
plaint for a key which has been used several hun- 
dred thousand times. 

The NSQ gives total N, sex composition, and 
average education for all norm groups. This has 
satisfied most test users, but more detailed de- 
scription will be considered in the future. 

In all tables and textual references, the NSQ 
Manual uses the basic trait names: “Tender- 
Mindedness,” “Depression,” “Submissiveness,” 
“Anxiety,” “Neuroticism” or “neurosis,” or well- 
known synonyms for these (e.g., “dependence” for 
“Submissiveness”). I hope Readers verify this for 
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themselves. I am astonished that any psychologist 
considers terms like “anxiety” and “depression” 
unfamiliar. I am even more astonished that by 
the time the reviewer gets around to calling them 
“unfamiliar,” he has already used them himself 
several times in the review without explaining 
them to anyone. 

The reviewer omitted the test author’s names— 
by his lights, mercifully—but now that a few 
points have been cleared up, it can be revealed 
that Raymond C. Cattell and I did it. 


Ivan H. Scheier 

The Institute for Personality and Ability 
Testing (IPAT) 

Champaign, Illinois 
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To the Editor: 


The interesting article by William M. Lesser in 
the Winter, 1961 issue (The relationship between 
counseling progress and empathic understanding) 
puzzles me. If I understand the study correctly, 
there are two aspects, one of design and the other 
related to one of the instruments, which invalidate 
the conclusions drawn by the author concerning 
empathy and counseling progress. 

Lesser concludes that because empathic under- 
standing (as measured by his instrument) did not 
correlate with counseling progress (as measured 
by changes in counselee self and self-ideal © 
sorts), then empathy is not related to client prog- 
ress. He did find, however, that both counselor 
and client ratings of empathic understanding 
were significantly higher for the continuing (i.e., 
the longer term clients) than for the terminated 
clients. Also, the terminated clients showed greater 
progress than did the continuing clients. It would 
appear that, as has been suggested by other studies 
(e.g., Cartwright, D. S., Success in psychotherapy 
as a function of certain actuarial variables, J. con- 
sult. Psychol., 1955, 19, 357-363), the short term 
clients and the long term clients were from differ- 
ent populations, in terms of severity if not kind 
of disturbance or problem. If empathy is positive- 
ly related to duration of counseling, and amount of 
progress is inversely related to duration, then 
one would expect the obtained negative correla- 
tions between empathy and progress. 
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But if duration is a relevant factor (as it obvious- 
ly is when it is significantly and inversely related 
to progress), then it would appear that any test 
of the relationship between progress and empathy 
should hold duration constant, or at least treat 
the short term (terminated) clients and the long 
term (continuing) clients separately. Lesser recog- 
nizes that the differing number of interviews opens 
the possibility that “some factor which was not 
here considered might be operating.” I’ow, then, 
can he conclude that his study does not substan- 
tiate the “generally accepted view that empathic 
understanding is very important in the counseling 
process”? 

A second point is that perhaps the instrument 
used to measure empathy is not limited to empathy. 
While it is reasonable to expect that empathy 
will increase with length of contact, it is also 
reasonable to expect that it is related to progress 
(as it might be if the confounding effect of dura- 
tion were eliminated). But there is also the possi- 
bility that the measure of empathy is affected by 
increasing knowledge about or familiarity with the 
client. It would thus be important to have some 
evidence of the validity of the scale before draw- 
ing conclusions regarding empathy. 

The dangers of drawing erroneous or unjustified 
conclusions from a study whose design does not 
allow the drawing of such conclusions seems to 
be illustrated here. I would appreciate it if some- 
one could indicate whether my understanding of 
this study is accurate or not. It is a little difficult 
to trust one’s judgment on an article which has 
been screened for publication and sponsored by 
such an eminent committee as this one. 

C. H. Patterson 
University of Illinois 


To the Editor: 

A recent re-study conducted at the University 
of California at Berkeley Counseling Center on the 
norms of the College Qualification Test vividly 
illustrates the need for renorming tests locally 
every. two or three years—as well as highlighting 
the current increase in ability levels of college 
students. 


The Counseling Center had originally normed 
the CQT in 1956 on approximately 96 per cent 
of the total entering freshman class. The present 
study compared the local percentile scores on 
the CQT-Verbal and the SAT-Verbal of 253 
freshmen seen at the Counseling Center in 1960. 
A mean percentile difference of 19.6 points was 
found in favor of the CQT Verbal score, suggest- 
ing that the 1956 norms were outdated. 

A previous study had shown that the freshman 
students seen at the Counseling Center did not 
differ significantly in intellectual ability from the 
total university freshmen. This study made it 
possible to compare the CQT Verbal mean of 
the 1960 Counseling Center freshman students 
and the 1956 university freshman Verbal mean. 
In 1960, the Counseling Center freshmen had a 
59.8 mean CQT Verbal score; in 1956 the univer- 
sity freshmen as a whole had a 53.4 mean Verbal 
CQT score. The difference of 6.4 is significant 
at the 5 per cent level. 


Roger W. Cummings and 
Barbara A. Kirk 
University of California 


From the Editor: 


Because of the very careful work of our profes- 
sional copyreader and proofreader, Mrs. Grace 
Warfield, this Journal has had very few typo- 
graphical errors during its nine-year lifetime. One 
slipped into the last issue, however, and for this 
we apologize. The correction that should be made 
is in the article by Klein, McNair,eand Lorr, en- 
titled SVIB Scores of Clinical Psychologists, Psy- 
chiatrists, and Social Workers. The error occurs on 
page 176, second column, lines 10 and 11, which 
should read: “between psychotherapists who have 
and who have not received personal psychother- 
apy.” The first two words, “who have” were 
omitted and this of course makes a difference 
in the meaning. I doubt that many readers will 
have noted the inconsistency, for the rest of the 
article is clear on the point that the comparison 
is between psychotherapists who have and who 
have not received psychotherapy. But the error 
should not have been made. Ed. 
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Test Reviews 


Laurence Siegel, 
Miami University 


The Academic Promise Tests. The Psycho- 
logical Corporation. New York, 1961. 


The Academic Promise Tests (APT) were de- 
signed for students in grades six to nine. The four 
tests included in the APT battery measure in the 
verbal, numerical, abstract reasoning and language 
usage areas. In addition to separate scores for each 
of these tests, the battery yields two combina- 
tion scores (verbal abilities and nonverbal abilities) 
and a total score. The latter is a single statement 
of the student’s general academic promise. 

Actual testing time required for the full battery 
is 90 minutes. Two equivalent forms of APT are 


available, each presented as a single reusable 


booklet containing the four component tests, 


Statistical Characteristics 

APT was issued with a Preliminary Manual to 
. . . permit immediate use of the tests.” A state- 
ment at the beginning of this manual indicates 
that a more detailed report of technical and statis- 
tical data will appear in the complete manual dur- 
ing 1962. In particular, the first regular edition of 
the manual will present data pertaining to predic- 
tive and concurrent validity. The present review 
was undertaken on the strength of the Prelimin- 
ary Manual because of current interest in the early 
identification of intellectually talented pupils. 

The specifications for APT require that each 
subtest: provide a suitable range of scores; be 
primarily a power test but brief enough to permit 
rapid administration; and possess satisfactory re- 
liability within each grade. 

The equivalence of the two forms of the battery 
was accomplished by pairing items on the basis of 
similarity of content, discrimination indices and 
difficulty values. These forms were administered 
with time intervals ranging between one and two 
weeks between administrations to provide alter- 
nate-forms reliabilities. The subtest coefficients for 
single grades range from .81 to .90 with a median 
of .87. The coefficients for combination scores 
(i.e., verbal and nonverbal) range between .88 to 
.92 with a median of .90. Total score reliability 
in the four grades is reported between .93 and .94. 

Normative data are presented in the form of per- 
centile band conversions. The representativeness 
and size of the standardization samples are par- 
ticularly impressive. The norms are based upon 
the performances of approximately thirty-five 
thousand students in grades six to nine. Census 
figures from 1960 were used to apportion the 


“ 


normative samples according to community size 
within each geographic region. The composition 
of the actual standardization group approximates 
the desired composition quite closely. 
Summary 

APT is designed to assess intellectual talent in 
grades six through nine. The test authors main- 
tain that under ordinary circumstances it will be 
unnecessary to supplement APT scores by ad- 
ministering other mental ability or intelligence 
tests. In essence, APT was developed in the 
spirit of the Differential Aptitude Tests but with- 
out its breadth. Restricted coverage seemed de- 
sirable in the case of younger students. 

Judgments about the validity of the battery 
must await publication of the complete manual. 
However, at this point, there appears to be little 
doubt that APT will prove to be a very useful 
battery for counseling junior high school students. 


Cooperative Test on Foreign Affairs. Edu- 
cational Testing Service, Princeton, 1962. 


In an era of emerging independent nations, in- 
creased international economic cooperation, and 
continuing international competition, an “under- 
standing of international relations” is a frequently 
stated educational objective. The Test on Foreign 
Affairs attempts to measure knowledges pre- 
requisite to such an understanding and the ability 
to apply them. The basic specification for the 
test was that it “. . . cover a variety of information 
of more than passing significance for an under- 
standing of American foreign policy.” Rather than 
measuring knowledge of current events, the test 
was designed to include questions likely to retain 
their significance over a period of five or more 
years. 

The Test on Foreign Affairs consists of 80 
four-choice items and requires about one hour to 
administer. The items require students to recall 
facts, draw inferences and apply knowledges. The 
test was originally designed for administration to 
college seniors who were not specialists in inter- 
national affairs, and the interpretative data cur- 
rently available are restricted to college seniors. 
However, the Handbook suggests that the test is 
suitable for administration to other college and 
adult populations. 

The Handbook is an interesting document con- 
taining the kinds of information usually found in 
“administrators’ manuals” and “technical manuals.” 
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In addition, five brief “Technical Notes” are boxed 
within its text. These notes, written for the rela- 
tively naive test user, concern (a) computation of 
t-ratio; (b) the meaning of standard deviation, 
median and quartile; (c) the concept of reliability; 
(d) the meaning of significance levels; (e) the use 
of item-test biserials for item analysis. The inclu- 
sion of these Technical Notes is an interesting 
device, and they are extremely well-written. 
Whether or not they will enhance the ability 
of relatively unsophisticated users to interpret data 
presented in the Handbook remains to be seen. 
Statistical Characteristics 

Data on this test resulted from administration 
to 1,854 seniors attending 175 colleges and uni- 
versities. The institutions chosen for participation 
in the test development were those visited by 
Percy W. Bidwell as part of his study of under- 
graduate education in foreign affairs. Each in- 
stitution was asked to administer the test to a ran- 
domly selected group of five to eight students. 

By far the most comprehensive statistical data 
presented for the Test on Foreign Affairs are those 
derived from item analyses. This kind of analysis 
was attempted for diagnostic purposes related to 
Dr. Bidwell’s investigation. Tabular summaries 
of item difficulties are presented for every item 
by curriculum, major field of study, type of in- 
stitution and geographical region; and alternative- 
analyses are presented for the total group. Al- 
though the item-test correlations are not presented 
in the Handbook, it is evident from the discus- 
sion that these also were computed. 

Several pages in the Handbook are devoted to a 
discussion of specific items answered correctly or 
incorrectly by substantial blocks of students. More 
to the point, from the viewpoint of test construc- 
tion, is the fact that this test appears to have 
plenty of “top.” Mean scores tend to run be- 
tween 40 and 50 with standard deviations usually 
in the vicinity of 11. Of the eight items, 45 were 
correctly answered by 50 per cent or more of 
the group and 35. were correctly answered by 
fewer than 50 per cent of the group. 

The test items have been reviewed to ascertain 
possible ambiguities. However, the test has not 
been revised in accord with this review. 

Reliability has been estimated from Kuder- 
Richardson formula 20 as .89. No validity coeffi- 
cents of any sort are cited, although the content 
validity of the Test on Foreign Affairs is obvious. 
Comparative test performance data for subgroups of 


seniors by major field of study, curriculum group 
and geographical location of college are presented 
but are difficult to interpret as evidence for valid- 
ity. 

Percentile norms are available in tabular form 
for the entire standardization group of college 
seniors and its component subgroups by curriculum 
(ie., business, education, engineering, liberal arts). 


Summary 

The Test on Foreign Affairs was developed by 
Educational Testing Service in response to a need 
for assessing knowledge in this area in conjunction 
with a study of undergraduate education in inter- 
national relations. It is distributed now to test 
users concerned with surveying the foreign affairs 
knowledge of “students and other personnel.” 

Researchers wishing to measure knowledge of 
foreign affairs will find the test well-suited to 
their needs. The fact that validity (other than 
content validity) is not established and that norms 
are not available for groups other than college 
seniors should not prove too disturbing to them. 

However, counselors wishing to assess achieve- 
ment in this area may be exasperated by a test with 
tremendous potential but lacking certain funda- 
mental corrollary information prerequisite to its 
intelligent use by them. The normative data for 
college seniors are good, but the major thrust of 
counseling is experienced prior to the senior year. 
The counselor usually needs to know something 
about the test performance of standardization 
groups representative of high school seniors, col- 
lege freshmen, and perhaps the general adult 
population. ‘@j 

Many interesting validity studies are self-evident 
for the Test on Foreign Affairs. The Handbook 
stops short with evidence that, of liberal arts 
seniors, those majoring in the social sciences have 
a higher mean score than either natural science 
or humanities majors. However, this begs the 
question of the test’s predictive usefulness for 
vocational attainment. 

Also concurrent validities, perhaps, involving 
well-known interest inventories as well as other 
cognitive measures, are not cited. It is at least 
conceivable that the Test on Foreign Affairs may 
share considerable variance with tests of general 
ability and verbal fluency. It is very difficult to 
judge the feasibility of including this test in either 
a counseling battery or a schoolwide achievement 
battery without evidence on this point. 
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A publishing friend of your Column Editor re- 
marked that recent information indicated that 
fully 80 per cent of all quality paperbacks sold 
are never finished by their readers. The who- 
dunnits, the westerns, popular novels, etc. are all 
read cover-to-cover but not the quality soft- 
bounds on history, science, philosophy, and the 
like. Mulling over his past reading habits, your 
Column Editor ruefully acknowledged that he 
has followed the same reading pattern except for 
his last two paperbacks. He has not finished (but 
he will, he will!) The Carpetbaggers by Harold 
Robbins (New York: Pocket Books, 1962) which 
is about the sexiest tale since the Decameron, 
judging from the first half of the novel. The scenes 
of la vie sportif in Hollywood will make the 
middle aged feel comfortably if wistfully righteous, 
while those under 40 will feel they are among 
the romantically unimaginative and underprivileged. 

The reason for your Column Editor’s not finish- 
ing this novel is that he started reading another 
paperback, a quality one this time, and he liked 
what it did to his cortex instead of his tempera- 
ture. This was The Counselor in a Changing World 
by C. Gilbert Wrenn (Washington, D.C. Ameri- 
can Personnel and Guidance Association, 1962). 
With its prefatory remarks, the book is 200 pages 
long and its sells for $1.00 to APGA members and 
$2.50 to anyone else, all on a nonprofit basis. 
According to APGA Guidepost, the book first pub- 
lished in March was sold out by July but a second 
printing of 10,000 copies is now available. Any- 
way, this particular paperback was just what your 
Column Editor needed for cortex fodder when 
Harry Brobst asked him to talk at the Oklahoma 
State University Counseling Institute last sum- 
mer. Maybe that’s why it was fairly easy to desert 
The Carpethaggers temporarily. 

The Counselor in a Changing World is an out- 
growth of a project sponsored by the Commission 
on Guidance in American Schools and a grant 
from the Fund for the Advancement of Education 
supported it. Dael Wolfle was chairman of the 
commission and C. Gilbert Wrenn was the project 
director. The other members of the commission 
were equally distinguished as administrators, edu- 
cators, psychologists, sociologists, and demograph- 
ers, to wit: Dugald Arbuckle, Kenneth Erickson, 
John H. Fischer, Nicholas Hobbs, Walter F. John- 


son, Seymour Lipset, George Mowrer, Merle Ohl- 
sen, Samuel Stauffer, Irene Taeuber, and Thelma 
Thurstone. Your Column Editor has no informa- 
tion on how the commission operated; however 
he has met a number of the members and they 
are leaders with firm convictions concerning their 
respective fields. With everybody singing the 
lead, harmony was probably not always perfect 
but volume was surely adequate. Perhaps that is 
why Dael Wolfle observed in the Preface that 
“Any particularly vigorous dissent . . .” would 
be footnoted. There are such footnotes. 

The Counselor in a Changing World is divided 
into two broad sections. The first section deals 
with present changes in our society with a look 
at what these ongoing changes will mean during 
the next decade or so. The second section is speci- 
fic to the school situation and the counselor’s 
changing role, together with recommendations 
concerning counseling programs and counselor 
training. The book is essentially a report and, 
while it deals with the present to some extent, its 
chief orientation is a concern for what the present 
direction of change means for school counseling 
in the future. As Wrenn points out, there is good 
reason for deep concern. Every ten years or so the 
total amount of human knowledge doubles and 
even the intellectually energetic counselor will 
have to hustle merely to keep up. Occupations 
which are common today, such as stenographers, 
in a decade or score of years, will have disap- 
peared into the vocational limbo where the black- 
smiths, stable hostlers, etc. of yesteryear now re- 
side. New occupations will appear which will be as 
strange to us today as a television repairman would 
have been to a housewife in the 1890's. 

Such changes and myriad others will be com- 
pounded by people—hordes of jostling people and 
most of them hungry. Population explosion is 
just a vivid phrase to us Americans, for we are 
well-fed and have room to expand in the future. 
For us, more people means worse traffic jams and 
longer lines at the supermarket checkout counter. 
But for most of the world it literally means starva- 
tion. We feel badly about this, of course, and we 
send Care packages; but we do not seem to grasp © 
the back-to-wall, sword-of-Damocles character 
of our situation. Let Wrenn’s quotation from 
mathematician J. D. Williams show what we are 
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up against (paraphrased): think of the Earth as 
a cellar 25 by 25 feet. Three-quarters of the cellar 
is flooded (the oceans) and 16 persons inhabit the 
dry one-fourth. One of the 16 is an American 
who has a 6 by 2 foot dry spot and he has half 
of all the food and other goodies. Of the re- 
maining 15 persons, 10 are hungry and incredibly 
poor. But all of the 15 are armed with powerful 
weapons of one kind or another. The American is 
preoccupied with his goodies and his isolation— 
so are the others in the cellar but they know the 
American is not isolated. The counselor will have 
to be aware of this situation. He will have to be 
prepared to work in huge metropolitan areas 
where he will be concerned with vocations and 
new problems that stem from our onrushing tech- 
nology and the world population explosion. To 
quote Wrenn (p. 42), “The school counselor can- 
not afford to be a graduate student in psychology 
and a second grader in economics.” There are 15 
others in the cellar, like it or not. 

The harried counselor may possibly seek comfort 
in the thought that, while the world is changing 
at a dizzying pace, human behavior doesn’t change 
and counseling is still primarily concerned with 
people. Inexorably, Wrenn goes on to remind us 
that, true enough, human behavior does not 
basically change but ideas about human behavior 
do change and are changing. He is constructive, 
however, and offers the reader a tightly-knit re- 
view of the areas of change and each area is fol- 
lowed by a short list of recommended readings that 
will bring the counselor up-to-date. By and large, 
the suggested readings are sensibly pertinent and 
recent. One book published in 1937 is, however, 
a strange inclusion for a report dealing with the 
Space Age and the weird new world of tomorrow. 
But, then, if we can profit from reading William 
James after more than sixty years, we can prob- 
ably derive similar benefit from Karen Horney 
after a quarter century. Be that as it may, this 
section of the book has a sound review in capsule 
form of what has been emerging in areas signifi- 
cant for the counselor such as learning, motivation, 
personality appraisal, vocational choice, human 
abilities, and influences on psychological thinking. 
Only a few paragraphs are devoted to each topic 
but enough is said to tell the counselor what he 
may not know and what he can do to fill in any 
gaps in his knowledge. 

In 1962-63 there are 50 million students in 
American schools, and school counselors, in theory, 
are concerned with all of them. A sizable number 
of these students have special needs—i.e., students 
who are talented or handicapped or alienated. 
Yet the counselor is severely limited in the time 
he has for service. Wrenn suggests that, until coun- 
seling services are fully available, all that a 
counselor can do is face the present situation 
squarely and (1) work with those students whose 
developmental needs are greatest, who have most 
difficulty in achieving a sense of personal identity; 
(2) work with those students for whom full under- 
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standing and motivation will mean the most to 
themselves and to society. These principles are 
presented as guidelines with full recognition that 
they are but a partial means of coping with a 
grave problem, certainly not a final solution. 
Furthermore, in coping with the problem, the coun- 
selor will have to put up with a horde of philistines 
who hold firmly the conviction that they know 
far more about educating the youth of today than 
any tatterdemalion professional. These are the ones 
who say, directly or by implication, “If you’re so 
smart, why ain’t you rich like me.” This does not 
mean that the counselor must suffer gladly the 
admiral who is quite certain he knows all about 
education because he can build a submarine or 
the ex-playboy who is also sure he knows how to 
educate the youth of America because he had the 
wit to choose a father who had mastered the 
modern alchemy of wringing gold out of immi- 
grant Polish coal miners. Freedom to indulge in 
such carping, fair or unfair, is one cost of a free 
se and the school counselor must recognize 
this. 

The counselor of the future will be less in- 
volved in the negative task of remediation and, 
while the change is slow, he will spend less time 
in a study hall because the economics of a $7,000 
a year person doing a $3,000 a year job will dawn 
on school administrators. At present, most school 
counselors are re-treaded teachers and this will 
change, indeed, is already changing with the 
counselor now being specifically educated for 
his job. An unresolved question is whether a 
school counselor must be qualified as a teacher 
and have teaching experience. Author Wrenn 
feels that lack of a teaching certificate should not 
bar an otherwise qualified person from counseling; 
however, some of the commission members insist 
that counselors in schools must also be fully certi- 
ficated teachers. The future counselor will be heav- 
ily grounded in psychological understanding and his 
training will probably be under the aegis of a col- 
lege of education. The Counselor in a Changing 
World has a good deal to say about counselor 
preparation and it all makes good sense. But in 
this reviewer’s opinion the practical, space-age 
recommendations outlined in the book will be dif- 
ficult to put into effect if there is a rigid insistence 
that school counselors must have teaching certifi- 
cates and teaching experience. Professional pre- 
paration time, after all, is not unlimited. In any 
event, this dilemma will have to be resolved be- 
fore specific programs in school counseling can 
be put fully into operation. 

There are many other points worth pondering in 
Wrenn’s report. They are too numerous to evalu- 
ate and anyway, Gentle Reader, why take away 
your fun? You will want to have your cortical 
synapses stirred, your anxieties allayed, and pos- 
sibly your ire aroused by what is the most sig- 
nificant report on counseling in the past decade. 

Just a year ago, your Column Editor mentioned 
that the revised edition of Appraising Vocational 














Book Reviews 287 


Fitness by Means of Psychological Tests by Donald 
E. Super and John O. Crites (New York: Harper, 
1962) was soon to appear but just too late for 
review at that time. Many counselors will have 
seen the revised edition by now and all counselors 
are undoubtedly familiar with the first. edition; 
yet it seems worthwhile to comment briefly on 
what Super and Crites (1962) have done to Super 
(1949). The 1949 work was 748 pages and the 
1962 revision is 703 pages, including the prefaces; 
so there isn’t much difference in length. There is, 
however, a difference in focus and in the intensity 
of test coverage. 

As Super notes in the revised edition preface, 
the 1962 edition is concerned with the test user; 
hence description of experimental tests and ad- 
vancements in test development which were given 
some attention in the original edition are now 
excluded. In exchange, much more detailed in- 
formation is given about those tests which were 
still included in 1962 because much more is now 
known. For example, at the time the first edition 
was written about 100 studies on the MMPI had 
been published; now there are about one thousand 
MMPI articles in print. Some tests which were in 
the first edition, such as the Bernreuter and Bell 
Adjustment Inventory, have been dropped from 
the new edition. But other new tests have been 
added, i.e., the WAIS, Rotter Incomplete Sen- 
tences Test, Edwards Personal Preference Inven- 
tory. Super 1949 was quite exhaustive in biblio- 
graphic citation of psychological test research 
while Super-Crites 1962 is selective. Rather wisely 
the authors leave to Buros’s Mental Measurements 
Yearbook the fuller listings of such references. In 
this respect the old edition was like a shotgun 
and the new one like a rifle. Both editions were 
chiefly concerned, of course, with the person who 
used tests for practical purposes of appraisal but 
the revised edition hews much more closely to this 
line. 

Super-Crites has separate indexes for authors, 
subject matter, and tests—a handier arrangement 
than the single potpourri index of the first edition. 
There are a few minor indexing errors. Our fel- 
low trencherman-counselor George S. Speer is 
listed as Spear for one set of references and also 
(correctly) as Speer for another. Pauline Pepinsky 
is correctly listed but her husband becomes Harold 
B. Pepinsley. Pepinsley has a tinkley sound which 


simply doesn’t fit your Column Editor’s fond 
recollections of his cut-and-thrust, slit-your weas- 
and adventures with the full-throated sound of 
Pepinsky. But enough of such trivia. Super-Crites 
(1962) is simply the best book of its kind. That’s 
a flat statement and it’s meant to be. 

And now for a petit dejeuner of various books 
useful for breaking any intellectual fast. Experi- 
mental Foundations of Clinical Psychology edited 
by Arthur J. Bachrach (New York: Basic Books, 
1962) is a 641-page harbinger of the probable 
shape and mood of clinical psychology to come. 
As the first word of the title indicates, it is experi- 
mental in orientation; yet, while not a handbook 
for clinicians, there is much of immediate value 
for the clinical and/or counseling psychologist. 
For the counseling researcher it will bring him 
up to date on research and serve as a guide for 
bettering his own research efforts. Similar in 
orientation but aimed more at the college under- 
graduate is Personality: A Behavioral Science by 
E. E. Baughman and G. S. Welsh (New York: 
Prentice-Hall, 1962). The book is eclectic, rooted 
in research, and solidly executed. Also aimed at 
the undergraduate student is Personality: A Psy- 
chological Interpretation by Gordon W. Allport 
(New York: Holt, Rinehart, and Winston, 1961). 
It is an extension and revision of Allport’s 1937 
volume of the same title. Emphasis is on the nor- 
mal person with the rich harvest of Allport’s four 
decades of pondering and probing the secrets of 
personality. For those who seek an unusually 
thorough coverage of research and theory The Ex- 
ceptional Child edited by E. P. Trapp and Philip 
Himelstein is the answer. It is carefully done and 
covers a wide range of behavioral. conditions. 
How to make the most of a college education is 
the theme of Introduction to College Life edited 
by N. T. Bell, R. W. Burkhardt, and V. D. Law- 
head (New York: Houghton Mifflin, 1962). It is 
in paperback format and consists of 25 sprightly 
selections dealing with such varied topics as 


_ “What Happens to C Students?” and “Why Fresh- 


men Fail” to “Blueprint for an Ideal College.” One 
chapter is titled “What Every Yale Freshman 
Should Know.” Judging from the Alma Mater 
roster of those high in national affairs, your 
Column Editor is driven to observe that every 
Yale freshman should know he ought to have gone 
to Harvard. Veritas! 
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